【Apache Tika】Apache Tika API Usage Examples

是 否 +2 论坛币

k人 参与回答

经管之家送您一份

应届毕业生专属福利!

求职就业群

赵安豆老师微信：zhaoandou666

经管之家联合CDA

送您一个全额奖学金名额~ !

立即领取

感谢您参与论坛问题回答

经管之家送您两个论坛币！

+2 论坛币

Apache Tika API Usage Examples

[size=17.3333339691162px]This page provides a number of examples on how to use the various Tika APIs. All of the examples shown are also available in the Tika Example module in SVN.

• Apache Tika API Usage Examples
  • Parsing
    • Parsing using the Tika Facade
    • Parsing using the Auto-Detect Parser
      
  • Picking different output formats
    • Parsing to Plain Text
    • Parsing to XHTML
    • Fetching just certain bits of the XHTML
      
  • Custom Content Handlers
    • Extract Phone Numbers from Content into the Metadata
    • Streaming the plain text in chunks
      
  • Translation
    • Translation using the Microsoft Translation API
      
  • Language Identification
  • Additional Examples
    
  
  

扫码加我 拉你入群

请注明：姓名-公司-职位

以便审核进群资格，未注明则拒绝

分享0 收藏0 回帖

关键词：Examples example apache usage ExamP

1. Parsing using the Tika Facade
   
2. 
   
3. The Tika facade, provides a number of very quick and easy ways to have your content parsed by Tika, and return the resulting plain text
   
4. 
   
5. public String parseToStringExample() throws IOException, SAXException, TikaException {
   
6.     Tika tika = new Tika();
   
7.     try (InputStream stream = ParsingExample.class.getResourceAsStream("test.doc")) {
   
8.         return tika.parseToString(stream);
   
9.     }
   
10. }

复制代码

1. Parsing using the Auto-Detect Parser
   
2. 
   
3. For more control, you can call the Tika Parsers directly. Most likely, you'll want to start out using the Auto-Detect Parser, which automatically figures out what kind of content you have, then calls the appropriate parser for you.
   
4. 
   
5. public String parseExample() throws IOException, SAXException, TikaException {
   
6.     AutoDetectParser parser = new AutoDetectParser();
   
7.     BodyContentHandler handler = new BodyContentHandler();
   
8.     Metadata metadata = new Metadata();
   
9.     try (InputStream stream = ParsingExample.class.getResourceAsStream("test.doc")) {
   
10.         parser.parse(stream, handler, metadata);
    
11.         return handler.toString();
    
12.     }
    
13. }

复制代码

1. Parsing to Plain Text
   
2. 
   
3. By using the BodyContentHandler, you can request that Tika return only the content of the document's body as a plain-text string.
   
4. 
   
5. public String parseToPlainText() throws IOException, SAXException, TikaException {
   
6.     BodyContentHandler handler = new BodyContentHandler();
   
7. 
   
8.     AutoDetectParser parser = new AutoDetectParser();
   
9.     Metadata metadata = new Metadata();
   
10.     try (InputStream stream = ContentHandlerExample.class.getResourceAsStream("test.doc")) {
    
11.         parser.parse(stream, handler, metadata);
    
12.         return handler.toString();
    
13.     }
    
14. }

复制代码

1. Parsing to XHTML
   
2. 
   
3. By using the ToXMLContentHandler, you can get the XHTML content of the whole document as a string.
   
4. 
   
5. public String parseToHTML() throws IOException, SAXException, TikaException {
   
6.     ContentHandler handler = new ToXMLContentHandler();
   
7. 
   
8.     AutoDetectParser parser = new AutoDetectParser();
   
9.     Metadata metadata = new Metadata();
   
10.     try (InputStream stream = ContentHandlerExample.class.getResourceAsStream("test.doc")) {
    
11.         parser.parse(stream, handler, metadata);
    
12.         return handler.toString();
    
13.     }
    
14. }

复制代码

1. Fetching just certain bits of the XHTML
   
2. 
   
3. It possible to execute XPath queries on the parse results, to fetch only certain bits of the XHTML.
   
4. 
   
5. public String parseOnePartToHTML() throws IOException, SAXException, TikaException {
   
6.     // Only get things under html -> body -> div (class=header)
   
7.     XPathParser xhtmlParser = new XPathParser("xhtml", XHTMLContentHandler.XHTML);
   
8.     Matcher divContentMatcher = xhtmlParser.parse("/xhtml:html/xhtml:body/xhtml:div/descendant::node()");
   
9.     ContentHandler handler = new MatchingContentHandler(
   
10.             new ToXMLContentHandler(), divContentMatcher);
    
11. 
    
12.     AutoDetectParser parser = new AutoDetectParser();
    
13.     Metadata metadata = new Metadata();
    
14.     try (InputStream stream = ContentHandlerExample.class.getResourceAsStream("test2.doc")) {
    
15.         parser.parse(stream, handler, metadata);
    
16.         return handler.toString();
    
17.     }
    
18. }

复制代码

1. Streaming the plain text in chunks
   
2. 
   
3. Sometimes, you want to chunk the resulting text up, perhaps to output as you go minimising memory use, perhaps to output to HDFS files, or any other reason! With a small custom content handler, you can do that.
   
4. 
   
5. public List<String> parseToPlainTextChunks() throws IOException, SAXException, TikaException {
   
6.     final List<String> chunks = new ArrayList<>();
   
7.     chunks.add("");
   
8.     ContentHandlerDecorator handler = new ContentHandlerDecorator() {
   
9.         @Override
   
10.         public void characters(char[] ch, int start, int length) {
    
11.             String lastChunk = chunks.get(chunks.size() - 1);
    
12.             String thisStr = new String(ch, start, length);
    
13. 
    
14.             if (lastChunk.length() + length > MAXIMUM_TEXT_CHUNK_SIZE) {
    
15.                 chunks.add(thisStr);
    
16.             } else {
    
17.                 chunks.set(chunks.size() - 1, lastChunk + thisStr);
    
18.             }
    
19.         }
    
20.     };
    
21. 
    
22.     AutoDetectParser parser = new AutoDetectParser();
    
23.     Metadata metadata = new Metadata();
    
24.     try (InputStream stream = ContentHandlerExample.class.getResourceAsStream("test2.doc")) {
    
25.         parser.parse(stream, handler, metadata);
    
26.         return chunks;
    
27.     }
    
28. }

复制代码

1. Translation using the Microsoft Translation API
   
2. 
   
3. In order to use the Microsoft Translation API, you need to sign up for a Microsoft account, get an API key, then pass the key to Tika before translating.
   
4. 
   
5. public String microsoftTranslateToFrench(String text) {
   
6.     MicrosoftTranslator translator = new MicrosoftTranslator();
   
7.     // Change the id and secret! See http://msdn.microsoft.com/en-us/library/hh454950.aspx.
   
8.     translator.setId("dummy-id");
   
9.     translator.setSecret("dummy-secret");
   
10.     try {
    
11.         return translator.translate(text, "fr");
    
12.     } catch (Exception e) {
    
13.         return "Error while translating.";
    
14.     }
    
15. }

复制代码

1. Language Identification
   
2. 
   
3. Tika provides support for identifying the language of text, through the LanguageIdentifier class.
   
4. 
   
5. public String identifyLanguage(String text) {
   
6.     LanguageIdentifier identifier = new LanguageIdentifier(text);
   
7.     return identifier.getLanguage();
   
8. }

复制代码