Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

长文本摘要和推理速度 #1

Open
ZTurboX opened this issue Oct 18, 2021 · 3 comments
Open

长文本摘要和推理速度 #1

ZTurboX opened this issue Oct 18, 2021 · 3 comments

Comments

@ZTurboX
Copy link

ZTurboX commented Oct 18, 2021

对于长文章的文本摘要是否支持？
以及此方法的推理速度怎么样？
@SunnyGJing
Copy link
Owner

SunnyGJing commented Oct 22, 2021 •
edited
Loading

zhentao,你好

  1. 目前项目上处于模型迭代优化阶段，计划支持长文本输入(暂不支持)，到时会同步更新在本Git里
  2. 此方法支持组batch推理，自测batch_size=600，从416ms/条提速至19.2ms/每条；此外，支持Linux上多进程推理，解决CPU推理速度问题，多进程推理的代码在单独的branch里，明天我再更新下代码

@BCWang93
Copy link

  1. 到时会同步更新在本Git里

您好！我想问下，您打算怎么处理长文本呀？谢谢！

@SunnyGJing
Copy link
Owner

  1. 到时会同步更新在本Git里

您好！我想问下，您打算怎么处理长文本呀？谢谢！

您好，推荐用Roformer处理长文本

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@ZTurboX @SunnyGJing @BCWang93