GenAI by Hung-yi Lee 2024-01

It’s time to learn ML/GenAI with Dr Lee AGAIN in 2024.

Here is a quote from the new manga Frieren that show how fast this field is developing: Someone who is super strong 80yrs ago can be easily taken care by a apprentice, so DL knowledge from 8 weeks may need to be refreshed.

0 Couple of interesting points

The world model, is to let model output the coordinates of a city in a world map, and it works well.

Later, it covers 5 aspects of prompt engineer related topics.

1 Magic words

What works, liek CoT and EmotionPrompt

What’s not working? like politeness.

2 Add context

This could be few-shot learning. Interesting point is what if you provide flipped labels (wrong examples) to LLM, what would happen.

3 Decomposite the task

You can do step-by-step decomp, Self-reflection, self-consistency. When all combined together, that’s Tree of Throught.

4 Tools

RAG is type of tool using, and GPT really like to call DALL-E when “draw” is in the prompt.
A new paper AnyTool brings the tool usage to a new level!