Issues

• when q_len == 1,using “apply_rotary_pos_emb(None, key_states, cos, -sin, position_ids)”, why using -sin?

  bojone/rerope#22 · Filter by author zhenghuawang6 opened on Nov 26, 2024

• Generating same token

  bojone/rerope#21 · Filter by author Madhu000 opened on May 30, 2024

• "position_ids_q - position_ids_k < window" without abs()

  bojone/rerope#20 · Filter by author wzhcz8902 opened on May 20, 2024

• 请问在推理阶段，为什么需要对input部份计算注意力呢？

  bojone/rerope#11 · Filter by author Anditty opened on Nov 9, 2023
  1

• 运行 test.py 显存爆了

  bojone/rerope#6 · Filter by author liyi-ff opened on Aug 17, 2023
  3

• ntk_rope_mixed_init 中old_init是否可以简化，省略inv_freq、_set_cos_sin_cache()步骤

  bojone/rerope#5 · Filter by author samantha0-ops opened on Aug 15, 2023
  3

• Monkey patch for original LLaMA2 code.

  bojone/rerope#4 · Filter by author WeixuanXiong opened on Aug 14, 2023
  1

• rerope：为什么对大于train_seqlength的query token要稍微放大一点

  bojone/rerope#3 · Filter by author Liu20210916 opened on Aug 11, 2023
  2

• 测了一下千问

  bojone/rerope#2 · Filter by author af-74413592 opened on Aug 9, 2023
  5

• Excellent Idea！！！！

  bojone/rerope#1 · Filter by author 0three opened on Aug 8, 2023
  3