Join Lucidworks cofounder, Sr. Solutions Architect, and Lucene/Solr committer, Erik Hatcher for a webinar to explore how to build a personal document search app with the ease and power of Solr.

2. Solr’s example/files
from bin/post to /browse and beyond

3. $ bin/post -c your_collection your_data/
https://lucidworks.com/blog/2015/08/04/solr-5-new-binpost-utility/

4. https://lucidworks.com/blog/2015/12/08/browse-new-improved-solr-5/
http://localhost:8983/solr/<collection>/browse

5. example/files
•Distilled, simple, document type navigation
•Multi-lingual, localizable interface
•Language detection and faceting
•Phrase/shingle indexing and "tag cloud" faceting
•E-mail address and URL index-time extraction
•"instant search" (as you type results)

6. $ bin/solr start
$ bin/solr create -c files -d example/files
$ bin/post -c files ~/Documents
$ open http://localhost:8983/solr/files/browse
quick start

7. The UI is The App

8. document type filtering

10. language detection and faceting

11. • instant search
• localized interface
• HTML safe highlighting

12. URLs are UI too!
• /browse is stateless
• all parameters for the view must be passed on the URL
• and/or in config:
• request handler definition (core reload API)
• paramsets / params.json (real-time API, no reload)

13. /browse?type=pdf
browsing by document type

14. /browse?locale=de_DE
localizing the interface

15. URL comparison
• /browse?type=html&locale=de_DE
• /select?v.locale=de_DE&fq={!field%20f=doc_type%20v=html}
&wt=velocity&v.template=browse&v.layout=layout&q=*:*&facet.qu
ery={!ex=type%20key=all_types}*:*&facet=on&facet.field={!
ex=type}doc_type…

16. URL comparison: /browse
• /browse?type=html&locale=de_DE
• /select?v.locale=de_DE&fq={!field%20f=doc_type%20v=html}
&wt=velocity&v.template=browse&v.layout=layout&q=*:*&fac
et.query={!ex=type%20key=all_types}
*:*&facet=on&facet.field={!ex=type}doc_type…

17. URL comparison: type
• /browse?type=html&locale=de_DE
• /select?v.locale=de_DE&fq={!field%20f=doc_type%20v=html}
&wt=velocity&v.template=browse&v.layout=layout&q=*:*&facet.qu
ery={!ex=type%20key=all_types}*:*&facet=on&facet.field={!
ex=type}doc_type…

18. URL comparison: locale
• /browse?type=html&locale=de_DE
• /select?v.locale=de_DE&fq={!field%20f=doc_type%20v=html}
&wt=velocity&v.template=browse&v.layout=layout&q=*:*&facet.qu
ery={!ex=type%20key=all_types}*:*&facet=on&facet.field={!
ex=type}doc_type…

19. Solr Tips and Tricks within
• Indexing “pipeline”
• language detection
• document type identification
• e-mail address and URL extraction
• Top Phrases
• Query “pipeline”
• document type faceting and filtering
• UI localisation/localization

20. implementation: language detection
&facet.field=language (via params.json)
conf/solrconfig.xml:

21. implementation: document type identification
conf/update-script.js:

22. implementation: E-mail address and URL extraction
conf/email_url_types.txt
<URL>
<EMAIL>
/select?fl=id,email_ss,url_ss&wt=csv
conf/managed-schema:
conf/update-script.js:

24. implementation: Top Phrases
&facet.field=text_shingles
conf/managed-schema:

25. implementation: document type faceting and filtering
&type=[doc|pdf|image|…|all|unknown]
fq={!switch v=$type tag=type
case=‘*:*'
case.all=‘*:*'
case.unknown='-doc_type:[* TO *]’
default=$type_fq}
type_fq={!field f=doc_type v=$type}
facet.field={!ex=type}doc_type
f.doc_type.facet.mincount=0
f.doc_type.facet.missing=true
facet.query={!ex=type key=all_types}*:*

26. implementation: UI
conf/params.json:
conf/solrconfig.xml:

27. example/files: what’s next?
• Fix e-mail and URL field names (<email>_ss and <url>_ss, with angle brackets in field names), also add
display of these fields in /browse results rendering
• Improve quality of extracted phrases
• Extract, facet, and display acronyms
• Add sorting controls, possibly all or some of these: last modified date, created date, relevancy, and title
• Add grouping by doc_type perhaps
• fix debug mode - currently does not update the parsed query debug output (this is probably a bug in data
driven /browse as well)
• Harden update-script: it currently errors if documents do not have a "content" field
• Filter out bogus e-mail addresses
https://issues.apache.org/jira/browse/SOLR-8590

28. And beyond…
• Leveraging https://github.com/LucidWorks/fusion-solr-plugins
• Analytics
• Relevancy Tuning: signals feedback, parameter adjustments
• Landing pages, scripting, etc

29. Analytics

30. Landing Pages