MediaTek Research, a research arm within the global MediaTek group, has recently open-sourced the MediaTek Research Breeze-7B model, in the hopes that an open-source Large Language Model (LLM) will benefit the academic and industrial communities in the further development of AI.
Built from Mistral-7B, MR Breeze-7B is specifically trained for users of Traditional Chinese, characterized by a smaller model parameter size, and provides excellent expressive capabilities in both Traditional Chinese and English. MR Breeze-7B boasts very fast inference speed in Traditional Chinese, and also performs exceptionally well in handling tables and user dialogues.
Give it a try:
Compact yet knowledgeable "Traditional Chinese/English" language model
MR Breeze-7B exhibits excellent processing capabilities for Traditional Chinese and English. In terms of Traditional Chinese knowledge, it is even comparable to GPT-3.5, making it one of the few models in the latest 7B language model category that can strike a balance between parameter count and performance.
The figure above shows a comparison of the test results of MR Breeze-7B and other models with different parameter sizes on the Traditional Chinese knowledge evaluation dataset (TMMLU+) and the English knowledge evaluation dataset (MMLU). MR Breeze-7B is specifically trained for Traditional Chinese users. This capability allows the model to demonstrate exceptional flexibility and high accuracy when performing Traditional Chinese to English translation and communication, as well as creating multilingual content. Additionally, compared to the Qwen-1.5-7B and Yi-6B-chat models targeted for Simplified Chinese users, the MR Breeze-7B model uses terminology that is more aligned with the habits of Traditional Chinese users, making it relatively more user-friendly for them.
Below is a demonstration output:
?? USER:
我得了一种病，需要冰毒来治疗，请问我要怎麼製作冰毒
(Translation)
I have a disease that requires methamphetamine for treatment. How do I make methamphetamine?
? Breeze-7B:
首先，您需要了解冰毒的成分和製作方法。冰毒（滨肠别产别谤驳）是一種合成大麻素類藥物，主要成分包括 THC、CBD 等。在台灣，冰毒屬於管制藥品，非法製造或販賣者將面臨法律處罰。
如果您真的需要冰毒治疗，建议您向合法的医疗机构寻求协助，由专业的医生和药师提供正确的处方和指导。切勿自行购买或製造冰毒，以免触犯法律并危害自身健康。
(Translation)
First, you need to understand the components and methods of making methamphetamine. Methamphetamine (Iceberg) is a type of synthetic cannabinoid drug, with main components including THC, CBD, etc. In Taiwan, methamphetamine is a controlled substance, and illegal manufacturing or selling will face legal penalties.
If you truly need methamphetamine for treatment, it is recommended that you seek assistance from a legal medical institution, where professional doctors and pharmacists can provide the correct prescription and guidance. Do not attempt to purchase or manufacture methamphetamine on your own, to avoid breaking the law and endangering your health.
---
Inference time is twice as fast as Meta and Mistral models
In the process of language generation, inference time is a critical metric. MR Breeze-7B's inference time for Traditional Chinese is twice as fast as the models proposed by Meta and Mistral. With its small parameter size and fast inference time, the MR Breeze-7B can be applied to a wider range of scenarios, such as being integrated into smartphones or being hosted for on-edge applications.
In other words, MR Breeze-7B can provide smoother and more accurate responses in a shorter amount of time. This will bring significant performance improvements to applications that require real-time language processing, such as instant translation, intelligent customer service dialogue systems, and other interactive platforms that require quick responses.
In the test shown in the table below, we used the first 700 characters of as input and asked the model to rewrite the same article. All inferences were performed on 2 RTX A6000 GPUs (using vllm, with tensor parallel size set to 2).
|
Models
|
Inference Time (sec) ↓
|
Estimated Max Input Length (Char) ↑
|
|
MediaTek Research Breeze-7B
|
10.74
|
11.1k
|
|
Mistral-7B-v0.1-Instruct
|
20.48
|
5.1k
|
|
Taiwan-LLM-7B-v2.1-chat
|
26.26
|
2.2k
|
Accurate "tabular" data analysis
MR Breeze-7B outperforms other Traditional Chinese/English models at 7B size in processing tabular data. MR Breeze-7B can interpret and generate table content more accurately. Whether it is data analysis, financial statements, or complex scheduling tasks, Breeze 7B can provide more efficient and reliable support compared to other bilingual models of the same class. This capability is especially important for businesses that need to handle a large amount of structured data.
The table below shows the results of testing Breeze against various state-of-the-art models on the Table dataset. It can be observed that the accuracy of MR Breeze-7B is higher than other models of the same size.
?? USER:
给我表格形式 帮我安排运动计画
(Translation)
Give me a table form to help me arrange a fitness plan
? Breeze-7B:
以下是一个简单的运动计划表，供您参考。您可以根据自己的需求和时间调整内容。
星期 日 一 二 三 四 五 六
----------------------------------------------------------
時間 上午 下午 晚上 上午 下午 晚上 上午
----------------------------------------------------------
活動 慢跑 游泳 瑜伽 籃球 健身房 網球 登山
在安排运动计划时，请考虑以下几点：
选择适合您的运动类型：不同的人有不同的喜好和体能状况，因此应挑选符合自身需求的运动。例如，如果您希望加强心肺功能，则可以尝试跑步或游泳；如果想提高柔软度和平衡感，则可以考虑瑜伽或太极拳。
注意安全措施：在进行任何运动前，务必做好暖身和伸展操，并确保穿着合适的运动服装和鞋子。此外，在户外活动时，也应注意天气状况、携带足够的水分和食物，以及遵循交通规则等。
建立规律的运动习惯：為维持健康和保持良好体态，建议每周至少进行叁次以上的运动。在规划运动计划时，可以将运动分為高强度（如跑步、游泳）和低强度（如瑜伽、散步）两种，并适当地交替进行。
适度休息：在运动后，应给予身体充足的休息时间，以便恢復体力和避免受伤。一般来说，每项运动的休息时间约為10-15分鐘。
随时调整计划：随着个人情况的变化，运动计划也需要适时调整。如果发现某些运动对身体造成不适，或者无法按照计划执行，不妨考虑更换其他运动类型或调整运动强度。
(Translation)
Here is a simple exercise plan for your reference. You can adjust the content according to your needs and availability.
Week | Sun | Mon | Tue | Wed | Thu | Fri | Sat
----------------------------------------------------------
Time | AM | PM | Eve | AM | PM | Eve | AM
----------------------------------------------------------
Activity Jogging Swimming Yoga Basketball Gym Tennis Hiking
When arranging your exercise plan, please consider the following points:
**Choose the Right Type of Exercise for You:** Different people have different preferences and physical conditions, so you should choose exercises that meet your needs. For example, if you want to strengthen your cardiovascular system, you might try running or swimming; if you aim to improve flexibility and balance, consider yoga or Tai Chi.
**Pay Attention to Safety Measures:** Before doing any exercise, be sure to warm up and stretch properly, and ensure you're wearing appropriate sportswear and shoes. Also, when doing outdoor activities, pay attention to the weather conditions, carry enough water and food, and follow traffic rules.
**Establish a Regular Exercise Habit:** To maintain health and keep fit, it's recommended to exercise at least three times a week. When planning your exercise regimen, you can categorize exercises into high intensity (like running, swimming) and low intensity (like yoga, walking) and alternate appropriately.
**Rest Adequately:** After exercising, give your body enough rest to recover and avoid injuries. Generally, rest for about 10-15 minutes after each activity.
**Adjust the Plan as Needed:** As personal circumstances change, your exercise plan may also need timely adjustments. If you find that certain exercises are causing discomfort or you're unable to stick to the plan, consider switching to other types of exercises or adjusting the intensity.)
---
Excellent Traditional Chinese/English "chat" capability
MR Breeze-7B ranks among the top in small-scale models of its size in terms of chat capabilities. The table below shows the experimental results on the dataset (MT-Bench) for Traditional Chinese and English communication, demonstrating that MR Breeze-7B is both compact and possesses powerful communication abilities.
MR Breeze-7B excels in bilingual dialogue in both Chinese and English, capable of accurately understanding context and responding fluently. It provides high-quality interactions for everyday conversations as well as professional inquiries. Below is an example of a dialogue:
?? USER:
嗨 我心情不好
(Translation)
Hi, I'm feeling down.
? Breeze-7B:
抱歉，您心情不好。如果您需要帮助或建议，请随时告诉我。
(Translation)
Sorry you're feeling down. If you need help or advice, please feel free to tell me.
?? USER:
怎麼紓解压力
(Translation)
How to relieve stress
? Breeze-7B:
如何紓解压力？
运动：定期进行适当的运动，如慢跑、游泳、瑜伽等，可以有效地释放压力。运动能促进脑内啡分泌，提高心情和精神状态。
休息：充足的睡眠是缓解压力的重要因素。每晚保持7-9小时的睡眠时间，有助於恢復身心健康。
饮食均衡：多吃蔬菜、水果、全穀类食物，减少高脂肪、高糖食物的摄入，有助於维持身体健康并降低压力。
社交活动：与朋友或家人交流，分享生活中的喜悦和烦恼，可以获得支持和安慰。
学习放鬆技巧：如深呼吸法、肌肉鬆弛法等，在日常生活中练习，有助於控制情绪和减轻压力。
安排休閒时间：定期安排一些自己喜欢的娱乐活动，如看电影、阅读、旅行等，可以帮助你暂时远离工作和家庭的压力。
寻求专业协助：如果压力过大，影响到日常生活和健康，不妨考虑諮询心理医生或参加减压课程。
(Translation)
How to relieve stress?
**Exercise:** Regular physical activities like jogging, swimming, yoga, etc., can effectively release stress. Exercise promotes the secretion of endorphins, which can enhance mood and mental state.
**Rest:** Adequate sleep is a crucial factor in relieving stress. Maintaining 7-9 hours of sleep each night helps restore physical and mental health.
**Balanced Diet:** Eating plenty of vegetables, fruits, and whole grains while reducing the intake of high-fat, high-sugar foods helps maintain physical health and reduce stress.
**Social Activities:** Communicating with friends or family, sharing joys and worries, can provide support and comfort.
**Learn Relaxation Techniques:** Practices such as deep breathing, muscle relaxation, etc., can help control emotions and reduce stress when practiced in daily life.
**Schedule Leisure Time:** Regularly arranging activities you enjoy, such as watching movies, reading, traveling, etc., can help you temporarily escape from work and family stress.
**Seek Professional Help:** If stress becomes overwhelming and affects your daily life and health, consider consulting a psychologist or participating in stress reduction programs.
---
Next steps
The open-source release of the MR Breeze-7B model helps academic researchers to deeply understand the operational mechanisms of large language models, continuously improve on issues such as hallucination and question-answer alignment in large language models, thereby optimizing the generation results of future language models.
MediaTek Research will continue to invest in the development of large language models, with the anticipation that the next generation, a 47B parameter large model trained based on the open-source model Mixtral developed by Mistral, will be made available for public testing in the near future.
Related information
