model

CodeParrot

modelactivecodeparrot-9af77506·1 events·first seen 28d ago

Aliases: CodeParrot

Co-occurring entities

GitHub Code Dataset GPT-2 Accelerate Hugging Face

More like this (12)

CodeRabbit CodePath Code Llama CodeAgents MirrorCode Code with Claude GitHub Copilot CodeGemma CodeAct BigCode CodeMender Code as Agent Harness

Recent events (1)

3Hugging Face Blog·28d ago·source ↗

Training CodeParrot from Scratch

Hugging Face published a detailed walkthrough of training CodeParrot, a GPT-2-style language model trained from scratch on GitHub code data. The post covers dataset preparation, tokenizer training, model configuration, and distributed training setup using the Accelerate library. It serves as both a technical tutorial and a demonstration of open-source code generation model development practices circa late 2021.

Training Infrastructure Open Weights Progress GitHub Code Dataset CodeParrot GPT-2 +2 more