AIうぉ--!(ai-wo-katsuyo-shitai !)

AIを上手く使ってみせたい!!自分なりに。

固有表現抽出(NER)を動かしてみる2。(windows, python)。

固有表現抽出(NER)を動かしてみる2。(windows, python)。

参考にしたサイト

参考にしたというより、そのまま、動かしただけ。

github.com

結果

環境

windows10 python3.7

結果

時短のため、データを減らしたりしているので、全然、正しく動いてませんが。。。

                 0              1   2    3    4   5            6  7        8   \
Token        [CLS]  characterized  by  its  use  of  technicolor  ,  fantasy
Movie_Label      O              O   O    O    O   O            O  O        O

                       9  10       11     12 13   14         15          16  \
Token        storytelling  ,  musical  score  ,  and  memorable  characters
Movie_Label             O  O        O      O  O    O          O           O

            17   18    19   20      21  22        23   24       25    26 27  \
Token        ,  the  film  has  become  an  american  pop  culture  icon  .
Movie_Label  O    O     O    O       O   O         O    O        O     O  O

             28   29         30   31   32       33      34 35         36  \
Token        it  was  nominated  for  six  academy  awards  ,  including
Movie_Label   O    O          O    O    O        O       O  O          O

               37       38 39   40    41  42    43    44   45    46 47    48  \
Token        best  picture  ,  but  lost  to  gone  with  the  wind  ,  also
Movie_Label     O        O  O    O     O   O     O     O    O     O  O     O

                   49  50       51 52     53
Token        directed  by  fleming  .  [SEP]
Movie_Label         O   O        O  O      O

多少、データなりepochを増やした。

                0              1   2    3    4   5            6  7        8   \
Token        [CLS]  characterized  by  its  use  of  technicolor  ,  fantasy
Movie_Label      O              O   O    O    O   O            O  O  B-GENRE

                       9  10       11     12        13   14         15  \
Token        storytelling  ,  musical  score         ,  and  memorable
Movie_Label             O  O        O      O  I-RATING    O          O

                     16        17   18    19   20      21  22        23   24  \
Token        characters         ,  the  film  has  become  an  american  pop
Movie_Label           O  I-RATING    O     O    O       O   O         O    O

                  25    26        27  28   29         30   31   32       33  \
Token        culture  icon         .  it  was  nominated  for  six  academy
Movie_Label        O     O  I-RATING   O    O          O    O    O        O

                 34 35         36    37       38        39   40    41  42  \
Token        awards  ,  including  best  picture         ,  but  lost  to
Movie_Label       O  O          O     O        O  I-RATING    O     O   O

                  43       44       45       46 47    48        49  50  \
Token           gone     with      the     wind  ,  also  directed  by
Movie_Label  B-TITLE  I-TITLE  I-TITLE  I-TITLE  O     O         O   O

                     51        52        53
Token           fleming         .     [SEP]
Movie_Label  I-DIRECTOR  I-RATING  I-RATING

自分の関連記事

ai-de-seikei.hatenablog.com

コメント

まだ、中途半端です。