Democratizing Automation • 146 implied HN points • 21 Jul 23
- The Llama 2 model may be exhibiting trigger-happy behaviors due to excessive use of RLHF during training.
- There are challenges with GPU sizing for different model variants, with considerations for inference and fine-tuning.
- Meta's evaluation of the chat models reveals potential issues with model refusal rates and ensemble techniques.