Post

LLaVAR’s IT

Posted
By 1 min read
  • Paper: LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding
  • GitHub Link
  • Publisher: Arxiv
  • Author Affiliation: Georgia Tech
  • Type
    • SFT
    • RLHF
  • Multi-turn
    • ✔
    • ✖
  • Input Modalities $\rightarrow$ Output Modalities
    (I: Image, V: Video, A: Audio, 3D: Point Cloud, T: Text, B: Bounding box, Tab: Table, Web: Web page)
    • I+T $\rightarrow$ T
  • Source
    • MS-COCO, CC3M, LAION
  • Method
    • LLaVA + Auto.
  • I/V/A Scale
    • I
      • 20K
    • V
      • Not report
    • A
      • Not report
  • Dialog Turn
    • 2.27
  • Instance Scale
    • 174K
Arxiv
IT Dataset
This post is licensed under CC BY 4.0 by the author.