StepFun Releases Step 5 Preview Open Weights: 600B MoE, 27B Active, 1M Context
What happened
FP8 and BF16 checkpoints are live on Hugging Face and ModelScope. For developers, this is […] The post StepFun Releases Step 5 Preview Open Weights: 600B MoE, 27B Active, 1M Context appeared first on MarkTechPost .
Step 5 Preview is a sparse Mixture-of-Experts model from StepFun built for long-horizon agentic (AI that carries out multi-step tasks rather than answering one question) work. It has 600B total parameters, 27B active per token and up to 1M tokens of context. For developers, this is a new self-hostable option for coding agents, document analysis and finance workflows.