5 1

Mike Burnham

mlburnham

AI & ML interests

None yet

Recent Activity

new activity about 2 months ago

mlburnham/Political_DEBATE_DeBERTa_large_v1.1:Difference between this and v1.0

new activity 3 months ago

mlburnham/political_or_not:Label source

updated a dataset 4 months ago

mlburnham/polnli_hypothesis_stability

View all activity

Organizations

None yet

mlburnham's activity

New activity in mlburnham/Political_DEBATE_DeBERTa_large_v1.1 about 2 months ago

Difference between this and v1.0

#1 opened 2 months ago by

matous-volf

New activity in mlburnham/political_or_not 3 months ago

Label source

#2 opened 3 months ago by

matous-volf

updated a dataset 4 months ago

mlburnham/polnli_hypothesis_stability

Viewer • Updated Jan 18 • 8.98k • 18

published a dataset 4 months ago

mlburnham/polnli_hypothesis_stability

Viewer • Updated Jan 18 • 8.98k • 18

updated a collection 4 months ago

Political DEBATE

Collection

Zero-shot classifiers for political text. • 4 items • Updated Jan 11 • 2

updated 4 models 4 months ago

updated a collection 4 months ago

Political DEBATE

Collection

Zero-shot classifiers for political text. • 4 items • Updated Jan 11 • 2

replied to MoritzLaurer's post 4 months ago

Any plans to train a version of your zero-shot models on ModernBERT? I'm finding that ModernBERT is a huge boost in speed, and a slight drop in performance vs. DeBERTa when I tune it. Not sure if the performance drop is because your zero-shot models were such a strong foundation for transfer learning, or the strength of DeBERTa architecture on NLI.

reacted to MoritzLaurer's post with 👍 4 months ago

Post

2628

Quite excited by the ModernBERT release! 0.15/0.4B small, 2T modern pre-training data and tokenizer with code, 8k context window, great efficient model for embeddings & classification!

This will probably be the basis for many future SOTA encoders! And I can finally stop using DeBERTav3 from 2021 :D

Congrats @answerdotai , @LightOnIO and collaborators like @tomaarsen !

Paper and models here 👇https://huggingface.co/collections/answerdotai/modernbert-67627ad707a4acbf33c41deb