Open source 1.6B miniatures "Little Fox", outperforms similar models Qwen and Gemma
Ever since Chatgpt's inception, the number of LLM (Large Language Model) parameters seems to be a race to the bottom for each company.The GPT-1 parameter count was 117 million (117M), and its fourth generation, the GPT-4, has refreshed its parameter count to 18,000...