As stated, the maximum sequence length for the model is 512. Based on my experience, 512 tokens usually contain enough information to be able to classify with good accuracy, so it won’t affect the training too much :)
As stated, the maximum sequence length for the model is 512. Based on my experience, 512 tokens usually contain enough information to be able to classify with good accuracy, so it won’t affect the training too much :)
Distraction-free reading. No ads.
Organize your knowledge with lists and highlights.
Tell your story. Find your audience.
Read member-only stories
Support writers you read most
Earn money for your writing
Listen to audio narrations
Read offline with the Medium app
Master’s Student at Carnegie Mellon, Top Writer in AI, Top 1000 Writer, Blogging on ML | Data Science | NLP. Linkedin: https://www.linkedin.com/in/itsuncheng/