https://www.sitepoint.com/building-recipe-search-site-angular-elasticsearch/
ByAdam BardApril 15,2014
Have you ever wanted to build a search feature into an application? In the old days,you might have found yourself wrangling withSolr,or building your own search service on top ofLucene— if you were lucky. But,since 2010,there’s been an easier way:Elasticsearch.
Elasticsearch is an open-source storage engine built on Lucene. It’s more than a search engine; it’s a true document store,albeit one emphasizing search performance over consistency or durability. This means that,for many applications,you can use Elasticsearch as your entire backend. Applications such as…
Building a Recipe Search Engine
In this article,you’ll learn how to use Elasticsearch withAngularJSto create a search engine for recipes,just like the one atOpenRecipeSearch.com. Why recipes?
- OpenRecipesexists,which makes our job a lot easier.
- Why not?
OpenRecipes is an open-source project that scrapes a bunch of recipe sites for recipes,then provides them for download in a handy JSON format. That’s great for us,because Elasticsearch uses JSON too. However,we have to get Elasticsearch up and running before we can Feed it all those recipes.
Download Elasticsearchand unzip it into whatever directory you like. Next,open a terminal,cd
to the directory you just unzipped,and runbin/elasticsearch
(bin/elasticsearch.bat
on Windows). Ta-da! You’ve just started your very own elasticsearch instance. Leave that running while you follow along.
One of the great features of Elasticsearch is its out-of-the-Box RESTful backend,which makes it easy to interact with from many environments. We’ll be using theJavaScript driver,but you Could usewhichever one you like; the code is going to look very similar either way. If you like,you can refer to thishandy reference(disclaimer: written by me).
Now,you’ll need a copy of theOpenRecipes database. It’s just a big file full of JSON documents,so it’s straightfoward to write a quick Node.js script to get them in there. You’ll need to get the JavaScript Elasticsearch library for this,so runnpm install elasticsearch
. Then,create a file namedload_recipes.js
,and add the following code.
var fs = require('fs'); var es 'elasticsearch'var client = new es.Client({ host: 'localhost:9200' }; fs.readFile'recipeitems-latest.json', {encoding'utf-8'function(err) { if { throw err; } // Build up a giant bulk request for elasticsearch. bulk_request = datasplit'\n'reduce((bulk_request{ var obj; try { obj = JSONparse(line; } catch(e{ consolelog'Done reading'; return bulk_request} // Rework the data slightly recipe = { id: obj._id.$oid// Was originally a mongodb entry name.name.source.url.recipeYield.ingredients.prepTime.cookTime.datePublished.description ; bulk_requestpush{index: {_index'recipes''recipe': recipe.id; bulk_request(recipe; ; []; // A little voodoo to simulate synchronous insert var busy = false; var callback { console} busy // Recursively whittle away at bulk_request,1000 at a time. var perhaps_insert (!busy{ busy true; clientbulk{ body: bulk_requestslice(01000) ; bulk_request = bulk_request; console.length} .length > { setTimeout(perhaps_insert10else 'Inserted all records.'} ; perhaps_insert; ;
Next,run the script using the commandnode load_recipes.js
. 160,000 records later,we have a full database of recipes ready to go. Check it out withcurl
if you have it handy:
$ curl -XPOST http://localhost:9200/recipes/recipe/_search -d '{"query": {"match": {"_all": "cake"}}}'
ottom:32px; padding-top:0px; padding-bottom:0px; direction:ltr; font-family:Roboto,you might be OK usingcurl
to search for recipes,but if the world is going to love your recipe search,you’ll need to…
Build a Recipe Search UI
This is where Angular comes in. I chose Angular for two reasons: because I wanted to,and because Elasticsearch’s JavaScript library comes with an experimental Angular adapter. I’ll leave the design as an exercise to the reader,but I’ll show you the important parts of the HTML.
Get your hands on Angular and Elasticsearch Now. I recommendBower,but you can just download them too. Open yourindex.html
file and insert them wherever you usually put your JavaScript (I prefer just before the closingbody
tag myself,but that’s a whole other argument):
<script src="path/to/angular/angular.js"></script> "path/to/elasticsearch/elasticsearch.angular.js>
ottom:32px; padding-top:0px; padding-bottom:0px; direction:ltr; font-family:Roboto,let’s stop to think about how our app is going to work:
- The user enters a query.
- We send the query as a search to Elasticsearch.
- We retrieve the results.
- We render the results for the user.
The following code sample shows the key HTML for our search engine,with Angular directives in place. If you’ve never used Angular,that’s OK. You only need to kNow a few things to grok this example:
- HTML attributes starting with
ng
are Angular directives. - The dynamic parts of your Angular applications are enclosed with an
ng-app
and anng-controller
.ng-app
andng-controller
don’t need to be on the same element,but they can be. - All other references to variables in the HTML refer to properties on the
$scope
object that we’ll meet in the JavaScript. - The parts enclosed in
{{}}
are template variables,like in Django/Jinja2/Liquid/Mustache templates.
<div ng-app"myOpenRecipes" ng-controller"recipeCtrl> <!-- The search Box puts the term into $scope.searchTerm and calls $scope.search() on submit --> <section class"searchField> <form ng-submit"search()> <input type"textng-model"searchTerm"submitvalue"Search for recipes</form> </section<!-- In results,we show a message if there are no results,and a list of results otherwise. --> "results"no-recipesng-hide"recipes.length>No results</div> <!-- We show one of these elements for each recipe in $scope.recipes. The ng-cloak directive prevents our templates from showing on load. --> <article "recipeng-repeat"recipe in recipesng-cloak<h2> <a ng-href"{{recipe.url}}>{{recipe.name}}</a</h2<ul<li "ingredient in recipe.ingredients>{{ ingredient }}</li</ul> <p> {{recipe.description}} >... more at {{recipe.source}}</p</article<!-- We put a link that calls $scope.loadMore to load more recipes and append them to the results.--> "load-more"allResultsng-click"loadMore()>More...myOpenRecipes(via theng-app
attribute)./** * Create the module. Set it up to use html5 mode. */ window.MyOpenRecipes = angularmodule'myOpenRecipes'['$locationProvider'($locationProvider{ $locationProviderhtml5Mode(] For those new to Angular,the['$locationProvider',function($locationProvider) {...}]
business is our way of telling Angular that we’d like it to pass$locationProvider
to our handler function so we can use it. This system of dependency injection removes the need for us to rely on global variables (except the globalangular
and theMyOpenRecipes
we just created).ottom:32px; padding-top:0px; padding-bottom:0px; direction:ltr; font-family:Roboto,we’ll write the controller,named
recipeCtrl
. We need to make sure to initialize therecipes
,240)">allResults,andsearchTerm
variables used in the template,as well as providingsearch()
andloadMore()
as actions./** * Create a controller to interact with the UI. */MyOpenRecipescontroller'recipeCtrl''recipeService''$scope''$location'(recipescope{ // Provide some nice initial choices var initChoices [ "rendang""nasi goreng""pad thai""pizza""lasagne""ice cream""schnitzel""hummous" var idx = Mathfloor(Mathrandom) * initChoices// Initialize the scope defaults. $scope.recipes ; // An array of recipe results to display $scope.page = ; // A counter to keep track of our current page $scope.allResults ; // Whether or not all results have been found. // And,a random search term to start if none was present on page load. $scope.searchTerm = $locationsearch.q || initChoices[idx/** * A fresh search. Reset the scope variables to their defaults,set * the q query parameter,and load more results. */ $scope.search { $scope; $scope; $location{'q': $scope.searchTermloadMore/** * Load the next page of results,incrementing the page counter. * When query is finished,push results onto $scope.recipes and decide * whether all results have been returned (i.e. were 10 results returned?) */ $scope.loadMore { recipes($scope.page++then(results{ !== { $scope; } var ii ; for ; ii < results; ii.recipes[ii} // Load results on first run $scope You should recognize everything on the$scope
object from the HTML. Notice that our actual search query relies on a mysterIoUs object calledrecipeService
. A service is Angular’s way of providing reusable utilities for doing things like talking to outside resources. Unfortunately,Angular doesn’t providerecipeService
,so we’ll have to write it ourselves. Here’s what it looks like:MyOpenRecipesfactory'$q''esFactory'($qelasticsearch{ host: $locationhost+ ':9200' /** * Given a term and an offset,load another round of 10 recipes. * * Returns a promise. */ var search (termvar deferred = $qdefervar query { match{ _all: term ; client{ index{ size: from(offset || * : query (result; hits_in .hits || {for< hits_in{ hits_out(hits_in._source} deferredresolve(hits_out.rejectreturn deferred.promise// Since this is a factory method,we return an object representing the actual service. return { search: search Our service is quite barebones. It exposes a single method,240)">search(),that allows us to send a query to Elasticsearch’s,searching across all fields for the given term. You can see that in thequery
passed in the body of the call tosearch
:{"match": {"_all": term}}
._all
is a special keyword that lets us search all fields. If instead,our query was{"match": {"title": term}}
,we would only see recipes that contained the search term in the title.The results come back in order of decreasing “score”,which is Elasticsearch’s guess at the document’s relevance based on keyword frequency and placement. For a more complicated search,we Could tune the relative weights of the score (i.e. a hit in the title is worth more than in the description),but the default seems to do pretty well without it.
You’ll also notice that the search accepts an
offset
argument. Since the results are ordered,we can use this to fetch more results if requested by telling Elasticsearch to skip the firstnresults.Some Notes on Deployment
Deployment is a bit beyond the scope of this article,but if you want to take your recipe search live,you need to be careful. Elasticsearch has no concept of users or permissions. If you want to prevent just anyone from adding or deleting recipes,you’ll need to find some way to prevent access to those REST endpoints on your Elasticsearch instance. For example,OpenRecipeSearch.comuses Nginx as a proxy in front of Elasticsearch to prevent outside access to all endpoints but
recipes/recipe/_search
.Congratulations,You’ve Made a Recipe Search
ottom:32px; padding-top:0px; padding-bottom:0px; direction:ltr; font-family:Roboto,if you open
index.html
in a browser,you should see an unstyled list of recipes,since our controller fetches some randomly for you on page load. If you enter a new search,you’ll get 10 results relating to whatever you searched for,and if you click “More…” at the bottom of the page,some more recipes should appear (if there are indeed more recipes to fetch).That’s all there is to it! You can find all the necessary files to run this project onGitHub.
版权声明:本文内容由互联网用户自发贡献,该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 dio@foxmail.com 举报,一经查实,本站将立刻删除。