SlideShare uma empresa Scribd logo
1 de 11
Julius module mode
Sunao Hara
hara@cs.okayama-u.ac.jp
Okayama university
2013-08-21
References
• The Julius Book (改訂1.0.3 2010-06-04)
• http://julius.sourceforge.jp/juliusbook/ja/
• > このバージョンで書かれている内容は,Julius の
rev. 4.1.5 に対応する.
• Source code of Julius 4.2.3 (2013-06-30)
Juiliusモジュールサーバの動作
• -moduleオプションをつけるだけ
• TCP/10500 (デフォルト)で1クライアントのみ待
ちうけ
• モジュールサーバポートに音声データは送れない
• 別途adinnetなどを使う
• テキストベースのプロトコル
• リクエストは半角大文字のコマンド+改行(n)
• XMLライクなレスポンス
• 言語モデルのエントリの記号に注意
• たとえば、「<」,「>」, 「“」, 「‘」など。ありがちなの
は、「<sp>」
• HTMLサニタイズしてあれば、おそらく安全
コマンド(表10.3を引用)
システム関連
VERSION - バージョンを返
す
システム状態の制御
STATUS - 動作状態を返す
PAUSE - 停止する
TERMINATE - 停止する(強制)
RESUME - 再開する
DIE - システムを終了す
る
認識(SR)インスタンスの制御
LISTPROCESS - インスタンス一覧
ADDPROCESS Jconfパス インスタンスを追加(パスはサーバ上
の)
DELPROCESS SR-name インスタンスを削除
CURRENTPROCESS SR-name カレントインスタンスの指定
SHIFTPROCESS - カレントインスタンスを次に移行する
DEACTIVATEPROCESS SR-name インスタンスの無効化
コマンド例
コマンド VERSION
実行例 <ENGINEINFO TYPE="JuliusLib" VERSION="4.2.3" CONF="fast"/>
コマンド LISTPROCESS
実行例 <RECOGPROCESS INFO="STATUS">
<SR ID="1" NAME="SR_DICTATION" LMTYPE="PROB" LMVAR="NGRAM" LIVE="ACTIVE"/>
<SR ID="2" NAME="SR_GRAMMAR" LMTYPE="DFA" LMVAR="GRAMMAR" LIVE="ACTIVE"/>
</RECOGPROCESS>
コマンド STATUS
実行例 <SYSINFO PROCESS="ACTIVE"/>
コマンド例(システム状態制
御)
コマンド STATUS
実行例 <SYSINFO PROCESS="ACTIVE"/>
コマンド PAUSE
実行例 <STOPPROC/>
コマンド STAUS
実行例 <SYSINFO PROCESS=“SLEEP"/>
コマンド RESUME
実行例 <STARTPROC/>
コマンド STAUS
実行例 <SYSINFO PROCESS=“ACTIVE"/>
* 入力も再開されるため、<INPUT STATUS=“LISTEN”>もいずれ送られてくる
Recognition Engine Status
Active Sleep
PAUSE / <STOPPROC/>
RESUME / <STOPPROC/>
TERMINATE / <STOPPROC/>
STATUS / <SYSINFO PROCESS=“ACTIVE”> STATUS / <SYSINFO PROCESS=“SLEEP”>
* Input / Output
コマンド例
コマンド CURRENTPROCESS
(空行)
実行例 <RECOGPROCESS INFO=“CURRENT">
<SR ID="1" NAME="SR_DICTATION" LMTYPE="PROB" LMVAR="NGRAM" LIVE="ACTIVE"/>
</RECOGPROCESS>
コマンド CURRENTPROCESS
SR_GRAMMAR
実行例 <RECOGPROCESS INFO=“CURRENT">
<SR ID="2" NAME="SR_GRAMMAR" LMTYPE="DFA" LMVAR="GRAMMAR" LIVE="ACTIVE"/>
</RECOGPROCESS>
コマンド SHIFTPROCESS
実行例 <SR ID="1" NAME="SR_DICTATION" LMTYPE="PROB" LMVAR="NGRAM" LIVE="ACTIVE"/>
コマンド CURRENTPROCESS
(空行)
実行例 <RECOGPROCESS INFO=“CURRENT">
<SR ID="2" NAME="SR_GRAMMAR" LMTYPE="DFA" LMVAR="GRAMMAR" LIVE="ACTIVE"/>
</RECOGPROCESS>
* SHIFTの場合、<RECOGPROCESS>に囲まれていない(ver. 4.2.3)
Push型のメッセージ
• 音声入力スレッド
• <INPUT STATUS="LISTEN" TIME="1377049658"/>
• <INPUT STATUS="STARTREC" TIME="..."/>
• <INPUT STATUS="ENDREC" TIME="..."/>
• 音声認識スレッド
• <INPUTPARAM FRAMES="..." MSEC="..."/>
• <GMM RESULT="xxx" CMSCORE="..."/>
• <RECOGOUT>...</RECOGOUT>
• <RECOGFAIL/>
• <REJECTED REASON="...">
Timeline of module-messages
w/ “-norealtime” option
Listen
StartRec
<INPUT STATUS=“XXXX”/>
EndRec
<InputParam …/>
<StartRecog/> <EndRecog/>
<RecogOut>
</RecogOut>
adin
1st pass
2nd pass
Timeline of module-messages
w/ “-realtime” option
Listen
StartRec
<INPUT STATUS=“XXXX”/>
EndRec
<InputParam …/>
<StartRecog/> <EndRecog/>
<RecogOut>
</RecogOut>
adin
1st pass
2nd pass

Mais conteúdo relacionado

Destaque

PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024Neil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)contently
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Applitools
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at WorkGetSmarter
 
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...DevGAMM Conference
 
Barbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationBarbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationErica Santiago
 

Destaque (20)

PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
 
ChatGPT webinar slides
ChatGPT webinar slidesChatGPT webinar slides
ChatGPT webinar slides
 
More than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike RoutesMore than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike Routes
 
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
 
Barbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationBarbie - Brand Strategy Presentation
Barbie - Brand Strategy Presentation
 

Julius module mode

  • 1. Julius module mode Sunao Hara hara@cs.okayama-u.ac.jp Okayama university 2013-08-21
  • 2. References • The Julius Book (改訂1.0.3 2010-06-04) • http://julius.sourceforge.jp/juliusbook/ja/ • > このバージョンで書かれている内容は,Julius の rev. 4.1.5 に対応する. • Source code of Julius 4.2.3 (2013-06-30)
  • 3. Juiliusモジュールサーバの動作 • -moduleオプションをつけるだけ • TCP/10500 (デフォルト)で1クライアントのみ待 ちうけ • モジュールサーバポートに音声データは送れない • 別途adinnetなどを使う • テキストベースのプロトコル • リクエストは半角大文字のコマンド+改行(n) • XMLライクなレスポンス • 言語モデルのエントリの記号に注意 • たとえば、「<」,「>」, 「“」, 「‘」など。ありがちなの は、「<sp>」 • HTMLサニタイズしてあれば、おそらく安全
  • 4. コマンド(表10.3を引用) システム関連 VERSION - バージョンを返 す システム状態の制御 STATUS - 動作状態を返す PAUSE - 停止する TERMINATE - 停止する(強制) RESUME - 再開する DIE - システムを終了す る 認識(SR)インスタンスの制御 LISTPROCESS - インスタンス一覧 ADDPROCESS Jconfパス インスタンスを追加(パスはサーバ上 の) DELPROCESS SR-name インスタンスを削除 CURRENTPROCESS SR-name カレントインスタンスの指定 SHIFTPROCESS - カレントインスタンスを次に移行する DEACTIVATEPROCESS SR-name インスタンスの無効化
  • 5. コマンド例 コマンド VERSION 実行例 <ENGINEINFO TYPE="JuliusLib" VERSION="4.2.3" CONF="fast"/> コマンド LISTPROCESS 実行例 <RECOGPROCESS INFO="STATUS"> <SR ID="1" NAME="SR_DICTATION" LMTYPE="PROB" LMVAR="NGRAM" LIVE="ACTIVE"/> <SR ID="2" NAME="SR_GRAMMAR" LMTYPE="DFA" LMVAR="GRAMMAR" LIVE="ACTIVE"/> </RECOGPROCESS> コマンド STATUS 実行例 <SYSINFO PROCESS="ACTIVE"/>
  • 6. コマンド例(システム状態制 御) コマンド STATUS 実行例 <SYSINFO PROCESS="ACTIVE"/> コマンド PAUSE 実行例 <STOPPROC/> コマンド STAUS 実行例 <SYSINFO PROCESS=“SLEEP"/> コマンド RESUME 実行例 <STARTPROC/> コマンド STAUS 実行例 <SYSINFO PROCESS=“ACTIVE"/> * 入力も再開されるため、<INPUT STATUS=“LISTEN”>もいずれ送られてくる
  • 7. Recognition Engine Status Active Sleep PAUSE / <STOPPROC/> RESUME / <STOPPROC/> TERMINATE / <STOPPROC/> STATUS / <SYSINFO PROCESS=“ACTIVE”> STATUS / <SYSINFO PROCESS=“SLEEP”> * Input / Output
  • 8. コマンド例 コマンド CURRENTPROCESS (空行) 実行例 <RECOGPROCESS INFO=“CURRENT"> <SR ID="1" NAME="SR_DICTATION" LMTYPE="PROB" LMVAR="NGRAM" LIVE="ACTIVE"/> </RECOGPROCESS> コマンド CURRENTPROCESS SR_GRAMMAR 実行例 <RECOGPROCESS INFO=“CURRENT"> <SR ID="2" NAME="SR_GRAMMAR" LMTYPE="DFA" LMVAR="GRAMMAR" LIVE="ACTIVE"/> </RECOGPROCESS> コマンド SHIFTPROCESS 実行例 <SR ID="1" NAME="SR_DICTATION" LMTYPE="PROB" LMVAR="NGRAM" LIVE="ACTIVE"/> コマンド CURRENTPROCESS (空行) 実行例 <RECOGPROCESS INFO=“CURRENT"> <SR ID="2" NAME="SR_GRAMMAR" LMTYPE="DFA" LMVAR="GRAMMAR" LIVE="ACTIVE"/> </RECOGPROCESS> * SHIFTの場合、<RECOGPROCESS>に囲まれていない(ver. 4.2.3)
  • 9. Push型のメッセージ • 音声入力スレッド • <INPUT STATUS="LISTEN" TIME="1377049658"/> • <INPUT STATUS="STARTREC" TIME="..."/> • <INPUT STATUS="ENDREC" TIME="..."/> • 音声認識スレッド • <INPUTPARAM FRAMES="..." MSEC="..."/> • <GMM RESULT="xxx" CMSCORE="..."/> • <RECOGOUT>...</RECOGOUT> • <RECOGFAIL/> • <REJECTED REASON="...">
  • 10. Timeline of module-messages w/ “-norealtime” option Listen StartRec <INPUT STATUS=“XXXX”/> EndRec <InputParam …/> <StartRecog/> <EndRecog/> <RecogOut> </RecogOut> adin 1st pass 2nd pass
  • 11. Timeline of module-messages w/ “-realtime” option Listen StartRec <INPUT STATUS=“XXXX”/> EndRec <InputParam …/> <StartRecog/> <EndRecog/> <RecogOut> </RecogOut> adin 1st pass 2nd pass