Search results

step1 models are always the same as step0 models

bugSomething isn't workingSomething isn't working

Status: Open.

#1373 In EleutherAI/gpt-neox;

· StellaAthena opened on Feb 14, 2026

MoE Top-K Training

Status: Open.

#1364 In EleutherAI/gpt-neox;

· chuanyang-Zheng opened on Aug 11, 2025

AssertionError in position embedding (potentially due to missing clear_cache between batches of data)

bugSomething isn't workingSomething isn't working

Status: Open.

#1340 In EleutherAI/gpt-neox;

· ameyagodbole opened on Feb 25, 2025

[Questions] Context length extension.

question

Status: Open.

#1327 In EleutherAI/gpt-neox;

· iPRET opened on Dec 16, 2024

How to set the learning rate using WSD? As mentioned in MiniCPM

feature requestNew feature or requestNew feature or request

Status: Open.

#1326 In EleutherAI/gpt-neox;

· fxnie opened on Dec 16, 2024

Error when converting sequential model to HF

bugSomething isn't workingSomething isn't working

Status: Open.

#1323 In EleutherAI/gpt-neox;

· SilverSulfide opened on Nov 20, 2024

Can preprocess_data.py support Huggingface Dataset?

feature requestNew feature or requestNew feature or request

Status: Open.

#1321 In EleutherAI/gpt-neox;

· cafeii opened on Nov 13, 2024

_forward_step_fn does not always return two values so eval.py breaks if is_pipe_parallel is false

bugSomething isn't workingSomething isn't working

Status: Open.

#1320 In EleutherAI/gpt-neox;

· markNZed opened on Nov 12, 2024

DeeperSpeed cannot support BFloat16 and PipelineParallelism

bugSomething isn't workingSomething isn't working

Status: Open.

#1307 In EleutherAI/gpt-neox;

· jahatef opened on Oct 15, 2024

How to Load Model from pytorch_model.bin into Trained Model for Text Generation?

feature requestNew feature or requestNew feature or request

Status: Open.

#1254 In EleutherAI/gpt-neox;

· lieh1203 opened on Jul 15, 2024

what's the biggest dataset you've tried?

bugSomething isn't workingSomething isn't working

Status: Open.

#1253 In EleutherAI/gpt-neox;

· exnx opened on Jul 15, 2024

Assertion Error when Setting pipe_parallel_size or model_parallel_size in GPT-NeoX

bugSomething isn't workingSomething isn't working

Status: Open.

#1251 In EleutherAI/gpt-neox;

· lieh1203 opened on Jul 10, 2024