Sophie: mecab-0.96-1mdv2008.1 i586

mecab-0.96-1mdv2008.1.i586.rpm

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN"
"http://www.w3.org/TR/html4/strict.dtd">
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=EUC-JP">
<title>MeCab: ¥½¥Õ¥È¤ï¤«¤Á½ñ¤</title>
<link type="text/css" rel="stylesheet" href="mecab.css">
</head>
<body>

<h1>¥½¥Õ¥È¤ï¤«¤Á½ñ¤</h1>

<p>$Id: soft.html 65 2007-01-30 00:52:53Z taku-ku $;</p>

<h2>³µÍ×</h2>
<p>MeCab 0.90 ¤è¤ê¥½¥Õ¥È¤ï¤«¤Á½ñ¤¤Îµ¡Ç½¤¬ÉÕ¤¤Þ¤·¤¿. ¥½¥Õ¥È¤ï¤«¤Á½ñ¤¤Ï
ÆþÎÏÊ¸¤ËÂÐ¤·¤Æ²ÄÇ½¤Ê¤¹¤Ù¤Æ¤Î·ÁÂÖÁÇÎó¤ò¼þÊÕ³ÎÎ¨ÉÕ¤¤Ç½ÐÎÏ¤¹¤ëµ¡Ç½¤Ç¤¹.
Á´Ê¸¸¡º÷¤Î¥¤¥ó¥Ç¥¥·¥ó¥°¤Ë»È¤¦¤³¤È¤Ç,Ê£¹ç¸ì¤ÎÃ±¸ìÊ¬³ä¤ÎÛ£ËæÀÅù¤ò
²ò·è¤¹¤ë¤³¤È¤¬¤Ç¤¤Þ¤¹.
</p>

<p>¥½¥Õ¥È¤ï¤«¤Á½ñ¤¤Î¾ÜºÙ¤Ë¤Ä¤¤¤Æ¤Ï<a
href="http://chasen.org/~taku/publications/nlp2005.pdf">ÏÀÊ¸</a>¤ò¤´»²¾È²¼¤µ¤¤.</p>

<h2>Á´·ÁÂÖÁÇ¤Î½ÐÎÏ</h2>
<p>MeCab ¤Ï¥Ç¥Õ¥©¥ë¥È¤ÇºÇÅ¬²ò¤Î¤ß¤ò½ÐÎÏ¤·¤Þ¤¹. -a ¥ª¥×¥·¥ç¥ó¤ò»ØÄê¤¹¤ë¤È
ºÇÅ¬²ò¤Ç¤Ï¤Ê¤¯, ¥é¥Æ¥£¥¹Ãæ¤ÎÁ´·ÁÂÖÁÇ¤ò½ÐÎÏ¤·¤Þ¤¹.</p>

<pre>
% mecab -a
ÅìµþÅÔÄ£
Åìµþ    Ì¾»ì,¸ÇÍÌ¾»ì,ÃÏ°è,°ìÈÌ,*,*,Åìµþ,¥È¥¦¥¥ç¥¦,¥È¡¼¥¥ç¡¼
Åì      Ì¾»ì,¸ÇÍÌ¾»ì,°ìÈÌ,*,*,*,Åì,¥Ò¥¬¥·,¥Ò¥¬¥·
Åì      Ì¾»ì,¸ÇÍÌ¾»ì,ÃÏ°è,°ìÈÌ,*,*,Åì,¥Ò¥¬¥·,¥Ò¥¬¥·
Åì      Ì¾»ì,¸ÇÍÌ¾»ì,¿ÍÌ¾,Ì¾,*,*,Åì,¥Ò¥¬¥·,¥Ò¥¬¥·
Åì      Ì¾»ì,¸ÇÍÌ¾»ì,¿ÍÌ¾,À«,*,*,Åì,¥¢¥º¥Þ,¥¢¥º¥Þ
Åì      Ì¾»ì,°ìÈÌ,*,*,*,*,Åì,¥Ò¥¬¥·,¥Ò¥¬¥·
µþÅÔ    Ì¾»ì,¸ÇÍÌ¾»ì,°ìÈÌ,*,*,*,µþÅÔ,¥¥ç¥¦¥È,¥¥ç¡¼¥È
µþÅÔ    Ì¾»ì,¸ÇÍÌ¾»ì,ÃÏ°è,°ìÈÌ,*,*,µþÅÔ,¥¥ç¥¦¥È,¥¥ç¡¼¥È
µþ      Ì¾»ì,¸ÇÍÌ¾»ì,ÃÏ°è,°ìÈÌ,*,*,µþ,¥¥ç¥¦,¥¥ç¡¼
µþ      Ì¾»ì,¸ÇÍÌ¾»ì,¿ÍÌ¾,Ì¾,*,*,µþ,¥ß¥ä¥³,¥ß¥ä¥³
µþ      Ì¾»ì,¸ÇÍÌ¾»ì,¿ÍÌ¾,À«,*,*,µþ,¥¥ç¥¦,¥¥ç¡¼
ÅÔÄ£    Ì¾»ì,°ìÈÌ,*,*,*,*,ÅÔÄ£,¥È¥Á¥ç¥¦,¥È¥Á¥ç¡¼
ÅÔ      Ì¾»ì,ÀÜÈø,ÃÏ°è,*,*,*,ÅÔ,¥È,¥È
ÅÔ      Ì¾»ì,¸ÇÍÌ¾»ì,ÃÏ°è,°ìÈÌ,*,*,ÅÔ,¥ß¥ä¥³,¥ß¥ä¥³
ÅÔ      Ì¾»ì,¸ÇÍÌ¾»ì,¿ÍÌ¾,À«,*,*,ÅÔ,¥ß¥ä¥³,¥ß¥ä¥³
ÅÔ      Ì¾»ì,¸ÇÍÌ¾»ì,¿ÍÌ¾,Ì¾,*,*,ÅÔ,¥ß¥ä¥³,¥ß¥ä¥³
ÅÔ      Ì¾»ì,°ìÈÌ,*,*,*,*,ÅÔ,¥È,¥È
Ä£      Ì¾»ì,ÀÜÈø,°ìÈÌ,*,*,*,Ä£,¥Á¥ç¥¦,¥Á¥ç¡¼
Ä£      Ì¾»ì,¸ÇÍÌ¾»ì,ÃÏ°è,°ìÈÌ,*,*,Ä£,¥Á¥ç¥¦,¥Á¥ç¡¼
Ä£      Ì¾»ì,°ìÈÌ,*,*,*,*,Ä£,¥Á¥ç¥¦,¥Á¥ç¡¼
EOS
</pre>

<h2>¼þÊÕ³ÎÎ¨¤Î·×»»¤È½ÐÎÏ</h2>
<p>³Æ·ÁÂÖÁÇ¤Î¼þÊÕ³ÎÎ¨(¤½¤Î·ÁÂÖÁÇ¤¬ÆþÎÏÊ¸¤ÎÃæ¤Ç¤É¤Î¤¯¤é¤¤¤Î³ÎÎ¨¤Ç½Ð¸½¤¹¤ë
¤Î¤«)¤Î·×»»¤ò¹Ô¤¦¤Ë¤Ï, -a ¤È -l 2 ¥ª¥×¥·¥ç¥ó¤òÆ±»þ¤Ë»È¤¤¤Þ¤¹.
-l ¥ª¥×¥·¥ç¥ó¤Ï¤É¤ÎÄøÅÙ¤Î¥é¥Æ¥£¥¹¾ðÊó¤ò²òÀÏ»þ¤Ë¹½ÃÛ¤¹¤ë¤«¤ò»ØÄê¤¹¤ë¥ª¥×¥·¥ç¥ó¤Ç¤¹.
 -l2 ¤È»ØÄê¤¹¤ë¤³¤È¤Ç forwardbackward ¥¢¥ë¥´¥ê¥º¥à¤ò»È¤¤¼þÊÕ³ÎÎ¨¤Î·×»»¤ò¹Ô¤¤¤Þ¤¹.-l ¥ª¥×¥·¥ç¥ó¤Ï°Ê²¼¤Î¥ì¥Ù¥ë¤¬¤¢¤ê¤Þ¤¹.
</p>

<ul>
<li>-l 0: ºÇÅ¬²ò¤Î¤ß¤¬½ÐÎÏ²ÄÇ½¤Ê¥ì¥Ù¥ë (¥Ç¥Õ¥©¥ë¥È, ¹âÂ®)
<li>-l 1: N-best ²ò¤¬½ÐÎÏ²ÄÇ½¤Ê¥ì¥Ù¥ë (ÃæÂ®)
<li>-l 2: ¥½¥Õ¥È¤ï¤«¤Á½ñ¤¤¬²ÄÇ½¤Ê¥ì¥Ù¥ë (ÄãÂ®)
</ul>

<p>-l2 ¥ª¥×¥·¥ç¥ó¤ò»È¤¦¤ÈÉâÆ°¾®¿ôÅÀ±é»»¤¬Æþ¤ë¤¿¤á -l 0 ¤ËÈæ¤Ù¤Æ 8ÇÜÄøÅÙÃÙ¤¯¤Ê¤ê¤Þ¤¹.</p>

<p>³Æ·ÁÂÖÁÇ¤Î¼þÊÕ³ÎÎ¨¤ò½ÐÎÏ¤¹¤ë¤Ë¤Ï, -F ¥ª¥×¥·¥ç¥ó¤ò»È¤Ã¤Æ½ÐÎÏ¥Õ¥©¡¼¥Þ¥Ã¥È¤ò¸ÄÊÌ¤Ë½ÐÎÏ¤¹
¤ëÉ¬Í×¤¬¤¢¤ê¤Þ¤¹. ÄÌ¾ï %pP %pb ¤ò»È¤¤¤Þ¤¹. ½ÐÎÏ¥Õ¥©¡¼¥Þ¥Ã¥È¤Î»ØÄêÊýË¡¤Ï
<a href="format.html">¤³¤Á¤é</a>¤ò¤´Í÷²¼¤¶¤¤.</p>

<ul>
<li>%pP: ¼þÊÕ³ÎÎ¨
<li>%pb: ºÇÅ¬²ò¤Î¤È¤ * ¤½¤ì°Ê³°¤Ï¶õÇòÊ¸»ú
</ul>

<pre>
% mecab -l2 -a -F"%m %H %pP %pb\n" -E"EOS\n"
µþÅÔÂç³Ø
µþÅÔÂç³Ø Ì¾»ì,¸ÇÍÌ¾»ì,ÁÈ¿¥,*,*,*,µþÅÔÂç³Ø,¥¥ç¥¦¥È¥À¥¤¥¬¥¯,¥¥ç¡¼¥È¥À¥¤¥¬¥¯ 0.559944 *
µþÅÔÂç Ì¾»ì,¸ÇÍÌ¾»ì,ÁÈ¿¥,*,*,*,µþÅÔÂç,¥¥ç¥¦¥È¥À¥¤,¥¥ç¡¼¥È¥À¥¤ 0.073824  
µþÅÔ Ì¾»ì,¸ÇÍÌ¾»ì,°ìÈÌ,*,*,*,µþÅÔ,¥¥ç¥¦¥È,¥¥ç¡¼¥È 0.004990  
µþÅÔ Ì¾»ì,¸ÇÍÌ¾»ì,ÃÏ°è,°ìÈÌ,*,*,µþÅÔ,¥¥ç¥¦¥È,¥¥ç¡¼¥È 0.360982  
µþ Ì¾»ì,¸ÇÍÌ¾»ì,ÃÏ°è,°ìÈÌ,*,*,µþ,¥¥ç¥¦,¥¥ç¡¼ 0.000161  
µþ Ì¾»ì,¸ÇÍÌ¾»ì,¿ÍÌ¾,Ì¾,*,*,µþ,¥ß¥ä¥³,¥ß¥ä¥³ 0.000003  
µþ Ì¾»ì,¸ÇÍÌ¾»ì,¿ÍÌ¾,À«,*,*,µþ,¥¥ç¥¦,¥¥ç¡¼ 0.000096  
ÅÔ Ì¾»ì,ÀÜÈø,ÃÏ°è,*,*,*,ÅÔ,¥È,¥È 0.000166  
ÅÔ Ì¾»ì,¸ÇÍÌ¾»ì,ÃÏ°è,°ìÈÌ,*,*,ÅÔ,¥ß¥ä¥³,¥ß¥ä¥³ 0.000001  
ÅÔ Ì¾»ì,¸ÇÍÌ¾»ì,¿ÍÌ¾,À«,*,*,ÅÔ,¥ß¥ä¥³,¥ß¥ä¥³ 0.000006  
ÅÔ Ì¾»ì,¸ÇÍÌ¾»ì,¿ÍÌ¾,Ì¾,*,*,ÅÔ,¥ß¥ä¥³,¥ß¥ä¥³ 0.000072  
ÅÔ Ì¾»ì,°ìÈÌ,*,*,*,*,ÅÔ,¥È,¥È 0.000015  
Âç³Ø Ì¾»ì,¸ÇÍÌ¾»ì,ÃÏ°è,°ìÈÌ,*,*,Âç³Ø,¥À¥¤¥¬¥¯,¥À¥¤¥¬¥¯ 0.004919  
Âç³Ø Ì¾»ì,¸ÇÍÌ¾»ì,¿ÍÌ¾,Ì¾,*,*,Âç³Ø,¥À¥¤¥¬¥¯,¥À¥¤¥¬¥¯ 0.004441  
Âç³Ø Ì¾»ì,°ìÈÌ,*,*,*,*,Âç³Ø,¥À¥¤¥¬¥¯,¥À¥¤¥¬¥¯ 0.350523  
Âç Ì¾»ì,ÀÜÈø,°ìÈÌ,*,*,*,Âç,¥À¥¤,¥À¥¤ 0.003603  
Âç ÀÜÆ¬»ì,Ì¾»ìÀÜÂ³,*,*,*,*,Âç,¥À¥¤,¥À¥¤ 0.001123  
Âç ÀÜÆ¬»ì,Æ°»ìÀÜÂ³,*,*,*,*,Âç,¥ª¥ª,¥ª¡¼ 0.000011  
Âç Ì¾»ì,¸ÇÍÌ¾»ì,ÃÏ°è,°ìÈÌ,*,*,Âç,¥ª¥ª,¥ª¡¼ 0.000171  
Âç Ì¾»ì,¸ÇÍÌ¾»ì,¿ÍÌ¾,Ì¾,*,*,Âç,¥Þ¥µ¥ë,¥Þ¥µ¥ë 0.000016  
Âç Ì¾»ì,°ìÈÌ,*,*,*,*,Âç,¥À¥¤,¥À¥¤ 0.001424  
³Ø Ì¾»ì,ÀÜÈø,°ìÈÌ,*,*,*,³Ø,¥¬¥¯,¥¬¥¯ 0.067828  
³Ø Ì¾»ì,¸ÇÍÌ¾»ì,ÃÏ°è,°ìÈÌ,*,*,³Ø,¥¬¥¯,¥¬¥¯ 0.001092  
³Ø Ì¾»ì,¸ÇÍÌ¾»ì,¿ÍÌ¾,Ì¾,*,*,³Ø,¥Þ¥Ê¥Ö,¥Þ¥Ê¥Ö 0.004203  
³Ø Ì¾»ì,°ìÈÌ,*,*,*,*,³Ø,¥¬¥¯,¥¬¥¯ 0.007051
EOS
</pre>

<p>-t ¿ôÃÍ ¥ª¥×¥·¥ç¥ó¤ò»È¤Ã¤Æ³ÎÎ¨ÃÍ¤Î¡Ö¤Ê¤á¤é¤«¤µ¡×¤òÊÑ¹¹¤¹¤ë¤³¤È¤¬¤Ç¤¤Þ¤¹.
¿ôÃÍ¤ò¾®¤µ¤¯¤ë¤È, ³ÎÎ¨ÃÍ¤¬¤Ê¤á¤é¤«¤Ë¤Ê¤ê, Ã»¤«¤¤·ÁÂÖÁÇ¤¬Âç¤¤Ê³ÎÎ¨ÃÍ¤ò
»ý¤Ä¤è¤¦¤Ë¤Ê¤ê¤Þ¤¹. ¿ôÃÍ¤òÂç¤¤¯¤¹¤ë¤ÈºÇÅ¬²ò¤Î³ÎÎ¨¤¬Âç¤¤¯¤Ê¤ê¤Þ¤¹.¥Ç¥Õ¥©¥ë¥È¤Ï 0.75 ¤Ç¤¹.</p>

<pre>
% mecab -l2 -a -F"%m %H %pP %pb\n" -t0.1 -E"EOS\n"
µþÅÔÂç³Ø
µþÅÔÂç³Ø Ì¾»ì,¸ÇÍÌ¾»ì,ÁÈ¿¥,*,*,*,µþÅÔÂç³Ø,¥¥ç¥¦¥È¥À¥¤¥¬¥¯,¥¥ç¡¼¥È¥À¥¤¥¬¥¯ 0.023617 *
µþÅÔÂç Ì¾»ì,¸ÇÍÌ¾»ì,ÁÈ¿¥,*,*,*,µþÅÔÂç,¥¥ç¥¦¥È¥À¥¤,¥¥ç¡¼¥È¥À¥¤ 0.052790  
µþÅÔ Ì¾»ì,¸ÇÍÌ¾»ì,°ìÈÌ,*,*,*,µþÅÔ,¥¥ç¥¦¥È,¥¥ç¡¼¥È 0.113576  
µþÅÔ Ì¾»ì,¸ÇÍÌ¾»ì,ÃÏ°è,°ìÈÌ,*,*,µþÅÔ,¥¥ç¥¦¥È,¥¥ç¡¼¥È 0.200919  
µþ Ì¾»ì,¸ÇÍÌ¾»ì,ÃÏ°è,°ìÈÌ,*,*,µþ,¥¥ç¥¦,¥¥ç¡¼ 0.206514  
µþ Ì¾»ì,¸ÇÍÌ¾»ì,¿ÍÌ¾,Ì¾,*,*,µþ,¥ß¥ä¥³,¥ß¥ä¥³ 0.157030  
µþ Ì¾»ì,¸ÇÍÌ¾»ì,¿ÍÌ¾,À«,*,*,µþ,¥¥ç¥¦,¥¥ç¡¼ 0.245554  
ÅÔ Ì¾»ì,ÀÜÈø,ÃÏ°è,*,*,*,ÅÔ,¥È,¥È 0.168921  
ÅÔ Ì¾»ì,¸ÇÍÌ¾»ì,ÃÏ°è,°ìÈÌ,*,*,ÅÔ,¥ß¥ä¥³,¥ß¥ä¥³ 0.090030  
ÅÔ Ì¾»ì,¸ÇÍÌ¾»ì,¿ÍÌ¾,À«,*,*,ÅÔ,¥ß¥ä¥³,¥ß¥ä¥³ 0.098721  
ÅÔ Ì¾»ì,¸ÇÍÌ¾»ì,¿ÍÌ¾,Ì¾,*,*,ÅÔ,¥ß¥ä¥³,¥ß¥ä¥³ 0.120077  
ÅÔ Ì¾»ì,°ìÈÌ,*,*,*,*,ÅÔ,¥È,¥È 0.131348  
Âç³Ø Ì¾»ì,¸ÇÍÌ¾»ì,ÃÏ°è,°ìÈÌ,*,*,Âç³Ø,¥À¥¤¥¬¥¯,¥À¥¤¥¬¥¯ 0.056029  
Âç³Ø Ì¾»ì,¸ÇÍÌ¾»ì,¿ÍÌ¾,Ì¾,*,*,Âç³Ø,¥À¥¤¥¬¥¯,¥À¥¤¥¬¥¯ 0.063926  
Âç³Ø Ì¾»ì,°ìÈÌ,*,*,*,*,Âç³Ø,¥À¥¤¥¬¥¯,¥À¥¤¥¬¥¯ 0.097919  
Âç Ì¾»ì,ÀÜÈø,°ìÈÌ,*,*,*,Âç,¥À¥¤,¥À¥¤ 0.150510  
Âç ÀÜÆ¬»ì,Ì¾»ìÀÜÂ³,*,*,*,*,Âç,¥À¥¤,¥À¥¤ 0.151888  
Âç ÀÜÆ¬»ì,Æ°»ìÀÜÂ³,*,*,*,*,Âç,¥ª¥ª,¥ª¡¼ 0.083163  
Âç Ì¾»ì,¸ÇÍÌ¾»ì,ÃÏ°è,°ìÈÌ,*,*,Âç,¥ª¥ª,¥ª¡¼ 0.101090  
Âç Ì¾»ì,¸ÇÍÌ¾»ì,¿ÍÌ¾,Ì¾,*,*,Âç,¥Þ¥µ¥ë,¥Þ¥µ¥ë 0.090363  
Âç Ì¾»ì,°ìÈÌ,*,*,*,*,Âç,¥À¥¤,¥À¥¤ 0.128706  
³Ø Ì¾»ì,ÀÜÈø,°ìÈÌ,*,*,*,³Ø,¥¬¥¯,¥¬¥¯ 0.233658  
³Ø Ì¾»ì,¸ÇÍÌ¾»ì,ÃÏ°è,°ìÈÌ,*,*,³Ø,¥¬¥¯,¥¬¥¯ 0.150100  
³Ø Ì¾»ì,¸ÇÍÌ¾»ì,¿ÍÌ¾,Ì¾,*,*,³Ø,¥Þ¥Ê¥Ö,¥Þ¥Ê¥Ö 0.174424  
³Ø Ì¾»ì,°ìÈÌ,*,*,*,*,³Ø,¥¬¥¯,¥¬¥¯ 0.200327 
EOS
</pre>

<h2>¥é¥¤¥Ö¥é¥ê¤«¤é¤ÎÍøÍÑ</h2>
<p>
-a ¥ª¥×¥·¥ç¥ó¤ò»ØÄê¤·¤¿¾ì¹ç, mecab_sparse_tonode ¤¬ÊÖ¤¹ node ¤Ï
Á´·ÁÂÖÁÇ¤òÃ©¤ë¤³¤È¤¬¤Ç¤¤ëÁêÊý¸þ¥ê¥¹¥È¤È¤Ê¤ê¤Þ¤¹. 
-l2 ¤ò»ØÄê¤¹¤ë¤È mecab_node_t::prob ¤Ë¼þÊÕ³ÎÎ¨¤¬ÂåÆþ¤µ¤ì¤Þ¤¹.</p>

<pre>
mecab_t *mecab;
mecab_node_t *node;

mecab = mecab_new2("-l2 -a");

node = mecab_sparse_tonode(mecab, input);
for (; node; node = node->next) {
  /* ºÇÅ¬²ò¤â¤·¤¯¤Ï³ÎÎ¨¤¬ 0.05 °Ê¾å¤Î¤È¤½ÐÎÏ */
  if (node->isbest || node->prob >= 0.05)  {
    fwrite (node->surface, sizeof(char), node->length, stdout);
    printf("\t%s\t%f\n", node->feature, node->prob);
  }
}
</pre>

<hr>
<p>$Id: soft.html 65 2007-01-30 00:52:53Z taku-ku $;</p>
</body>
</html>