Jason Corkill

jasoncorkill

7 12 74

https://rapidata.ai

AI & ML interests

Human data annotation

Recent Activity

posted an update 44 minutes ago

Researchers shouldn’t have to limit experiments because human feedback is too expensive/slow to collect. So, @RapidataAI is offering up to $50,000 in human annotation credits per research project (can be more for selected topics). Learn more on our website, and apply via email, we'll do our best to get back to you within 2 days :).

liked a dataset about 3 hours ago

Rapidata/mental-timeline-atlas

repliedto their post 1 day ago

Most public benchmarks collapse model performance into one broad preference signal. That makes it hard to understand which capabilities differentiate between models. It's also almost impossible to inspect the evidence behind it. So @RapidataAI is releasing Benchmark.AI. We started with an SVG generation benchmark including 42 models, 500 prompts, 1.9M+ human judgements, 300K+ match-ups. We evaluate models separately on Preference, Alignment and Coherence, while making the prompts, outputs, match-ups and methodology public. Full dataset: https://huggingface.co/datasets/Rapidata/svg-benchmark Full benchmark: https://www.benchmark.ai/svg Methodology feedback and benchmark suggestions very welcome!

View all activity

Organizations

Posts 24

Post

Researchers shouldn’t have to limit experiments because human feedback is too expensive/slow to collect.

So, @RapidataAI is offering up to $50,000 in human annotation credits per research project (can be more for selected topics).

Learn more on our website, and apply via email, we'll do our best to get back to you within 2 days :).

View all Posts

Articles 2

Article

Beyond Image Preferences - Rich Human Feedback for Text-to-Image Generation

View all Articles

models 0

None public yet

datasets 0

None public yet