微信公众号搜"智元新知"关注
微信扫一扫可直接关注哦!

pyLDAvis:可视化主题时验证错误

如何解决pyLDAvis:可视化主题时验证错误

我尝试使用 gensim 为 20000 条记录生成主题。在尝试可视化主题时,我收到验证错误。我可以在模型训练后打印主题,但不能使用 pyLDAvis。

corpus = descriptions_lem_stop

dic=gensim.corpora.Dictionary(corpus)
bow_corpus = [dic.doc2bow(doc) for doc in corpus]

lda_model = gensim.models.Ldamulticore(bow_corpus,num_topics = 30,id2word = dic,passes = 10,workers = 2)
lda_model.show_topics()


pyLDAvis.enable_notebook()
vis = pyLDAvis.gensim.prepare(lda_model,bow_corpus,dic)
vis

我收到错误

/opt/anaconda3/lib/python3.8/site-packages/pyLDAvis/gensim.py in prepare(topic_model,corpus,dictionary,doc_topic_dist,**kwargs)
    117     """
    118     opts = fp.merge(_extract_data(topic_model,doc_topic_dist),kwargs)
--> 119     return vis_prepare(**opts)

/opt/anaconda3/lib/python3.8/site-packages/pyLDAvis/_prepare.py in prepare(topic_term_dists,doc_topic_dists,doc_lengths,vocab,term_frequency,R,lambda_step,mds,n_jobs,plot_opts,sort_topics)
    372    doc_lengths      = _series_with_name(doc_lengths,'doc_length')
    373    vocab            = _series_with_name(vocab,'vocab')
--> 374    _input_validate(topic_term_dists,term_frequency)
    375    R = min(R,len(vocab))
    376 

/opt/anaconda3/lib/python3.8/site-packages/pyLDAvis/_prepare.py in _input_validate(*args)
     63    res = _input_check(*args)
     64    if res:
---> 65       raise ValidationError('\n' + '\n'.join([' * ' + s for s in res]))
     66 
     67 

ValidationError: 
 * Not all rows (distributions) in topic_term_dists sum to 1.

版权声明:本文内容由互联网用户自发贡献,该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 dio@foxmail.com 举报,一经查实,本站将立刻删除。