More sophisticated prompting methods that super users know.
🚀 Learning Objectives
Understand the concept of chain-of-thought (CoT) prompting and how it can significantly boost the performance of LLMs across various reasoning tasks.
Explore other master-level tactics like challenging your own assumptions, self-prompting, and prompt chaining.
Chain-of-Thought Prompting
In chain-of-thought (CoT) prompting, the model is prompted to break down a complex problem or task into a series of simpler, logical steps. Instead of directly providing an answer, the model is encouraged to think through the problem step-by-step, explaining its reasoning along the way.
Why does this matter?
Recent AI studies have demonstrated the remarkable impact of chain-of-thought (CoT) prompting in boosting the performance of large language models across diverse reasoning tasks.
On the challenging GSM8K math word problem benchmark, CoT prompting elevated accuracy of a given LLM (PaLM) from 17.9% to an impressive 58.1% [ref]. On the StrategyQA benchmark for commonsense reasoning, PaLM 540B with CoT prompting achieved 75.6% accuracy, surpassing the previous state-of-the-art of 69.4%.
CoT can make any model smarter. Plus it allows LLM to have "explainability" where you, as a human, can evaluate how it arrives at the answer.
Any teacher knows this works, because when you ask students to explain something out loud, it's either they realize they don't know the material or they magically give more accurate answer.
Try this prompt
CoT is very simple, just add the phrase "Let's think through it step-by-step" at the end of your prompt.
There is a new product: an automatic coffee maker that can brew a variety of coffee types in just 5 minutes. It's designed for use both at home and in the office. You work from home 3-4 days a week and buy coffee from a café at least 2 cups per day, plus another 2 cups at the office. Considering these habits, how would investing in an automatic coffee maker help you save money in the long run and make your daily life more convenient? Let's think through it step-by-step.
เรามีผลิตภัณฑ์ใหม่คือเครื่องทำกาแฟอัตโนมัติที่สามารถทำกาแฟได้หลากหลายประเภทภายในเวลาเพียง 5 นาที ซึ่งเหมาะสำหรับการใช้งานในบ้านและที่ทำงาน คุณทำงานที่บ้าน 3-4 วันต่อสัปดาห์ และซื้อกาแฟจากร้านกาแฟอย่างน้อย 2 แก้วต่อวัน รวมถึงใช้กาแฟในที่ทำงานอีก 2 แก้วต่อวัน คิดว่าการลงทุนในเครื่องทำกาแฟอัตโนมัติจะช่วยให้คุณประหยัดค่าใช้จ่ายในระยะยาวและทำให้ชีวิตประจำวันสะดวกขึ้นได้อย่างไร? Let's think through it step-by-step.
Response I got with CoT (ChatGPT)-Eng
Sure, let’s break it down:
Cost of Café Coffee:
Assuming the average cost of a cup of coffee is $4.
Total daily cost: 4 cups × $4 = $16.
Weekly cost (5 workdays): $16 × 5 = $80.
Monthly cost (20 workdays): $80 × 4 = $320.
Cost of Automatic Coffee Maker:
Let’s assume the automatic coffee maker costs $150 (this can vary based on brand and features).
Plus, there might be a cost for coffee beans or grounds, say $10 per month.
Brewing Cost at Home:
A pound of coffee beans can cost around $15 and can make roughly 40 cups of coffee.
Cost per cup of coffee: $15 / 40 = $0.375.
Monthly cost for 4 cups per day: 4 cups × $0.375 × 20 workdays = $30.
Home Use: With the coffee maker, you can brew coffee whenever you want without leaving home, saving time and effort.
Office Use: If you keep a stash of coffee beans at the office, you can use the coffee maker there as well, saving on those office coffee purchases.
Additional Benefits:
Variety: The automatic coffee maker can brew different types of coffee, so you can enjoy a range of options based on your mood or preference.
Time-Saving: Brewing coffee at home saves time that you would otherwise spend waiting in line at a café.
Customization: You can control the strength and size of each cup according to your taste.
In summary, investing in the automatic coffee maker can help you save a significant amount of money and offer greater convenience and customization in your daily coffee routine.
Investing in an automatic coffee maker could have several benefits for your daily routine and finances:
Cost Savings: If you’re buying coffee at a café at least 4 cups per day (2 at home and 2 at the office), that adds up quickly. Assuming an average cost of $4 per cup, you're spending $16 daily on coffee. If you work from home 3-4 days a week, that’s around $48-$64 per week, or roughly $192-$256 per month on coffee. An automatic coffee maker, especially one with a variety of brewing options, could cost between $100-$300 upfront but would save you money over time since you'll only need to purchase coffee beans or grounds.
Convenience: Having an automatic coffee maker at home means you can brew coffee quickly and conveniently without needing to make a trip to the café. This can be especially beneficial on your work-from-home days, as it saves you time and effort. The 5-minute brewing time is relatively quick, ensuring you won’t have to wait long for your coffee.
Customization: With a machine that can brew a variety of coffee types, you can experiment with different blends and styles to find your perfect cup. This flexibility allows you to enjoy a variety of coffee experiences without being limited to what's available at your local café.
Reduced Dependency on External Factors: You won’t have to rely on café hours or worry about long lines, and you can make coffee at your own schedule. This is particularly useful during busy mornings or if you want to enjoy a coffee break during the day.
Consistency: Automatic coffee makers often come with programmable features that allow you to set brewing times in advance. This means you can wake up to a freshly brewed cup or have coffee ready when you’re ready to start your day.
Overall, while the initial investment might seem significant, the long-term savings and added convenience could make an automatic coffee maker a worthwhile purchase.
Generative AI can be a powerful tool for challenging your own biases and exploring new perspectives. By prompting the AI to critically examine your ideas, you can uncover blind spots, consider alternative viewpoints, and ultimately strengthen your decision-making.
Prompt:
I’m a marketing manager for a food company, and I’m developing a new campaign to launch our line of organic snack bars. Here’s the target audience and messaging we’re considering:
Target Audience:
- Age: 20-45 years old
- Household Income: 30,000 - 60,000 THB per month
- Occupation: Office workers, entrepreneurs, or freelancers with a busy lifestyle
- Interests: Health and nutrition, seeking convenient and effective ways to maintain health
- Consumption Behavior: Enjoys trying new products with nutritional benefits, lives a busy lifestyle and looks for convenient snacks
- Challenges: Often doesn’t have time to prepare healthy meals, needs quick and convenient snack options
Messaging:
"Discover our new range of organic snack bars, perfect for your busy lifestyle. Made with 100% natural ingredients, our snack bars offer a delicious and nutritious option without the guilt. Whether you’re at the office, hitting the gym, or just need an energy boost, our snack bars provide satisfaction and joy. Choose health, choose convenience, choose our organic snack bars."
Before finalizing this campaign, I’d like you to challenge my assumptions. Will this approach resonate with the target audience? Please think through it step-by-step and provide detailed insights to help refine or pivot the strategy."
To effectively challenge your assumptions and refine your campaign, let's analyze the target audience and messaging step-by-step:
Target Audience Analysis
Age: 20-45 years old
Insight: This age range is broad and encompasses a variety of life stages and health priorities. Young professionals might prioritize convenience and energy, while older individuals might focus on health and wellness.
Challenge: Ensure that your messaging resonates across this spectrum. For younger adults, emphasize energy and convenience, while for older adults, focus more on health benefits.
Household Income: 30,000 - 60,000 THB per month
Insight: This income range suggests a middle to upper-middle-class audience with some disposable income but still value-driven when it comes to spending.
Challenge: The pricing of your snack bars should reflect value for money. Ensure that the premium associated with organic products is justified by clear benefits.
Occupation: Office workers, entrepreneurs, or freelancers
Insight: This group has a high demand for convenience due to their busy schedules. They may be looking for quick, healthy snacks that fit into a hectic day.
Challenge: Ensure that the convenience of your product is highlighted. Consider packaging that is easy to carry and consume on the go.
Interests: Health and nutrition
Insight: Your audience values health, so emphasizing the nutritional benefits is key.
Challenge: Clearly communicate how your snack bars contribute to their health goals. Use specific benefits (e.g., high in protein, low in sugar) to attract this interest.
Consumption Behavior: Enjoys trying new products with nutritional benefits
Insight: They are open to new products, especially those that promise health benefits.
Challenge: Highlight what makes your product unique compared to existing options. Differentiate on flavor, ingredient quality, or additional health benefits.
Challenges: Lack of time to prepare healthy meals
Insight: Convenience is crucial. Your product should solve this problem effectively.
Challenge: Stress the convenience of your snack bars as a solution to their busy lifestyles.
Messaging Analysis
"Discover our new range of organic snack bars, perfect for your busy lifestyle."
Insight: This line emphasizes convenience and lifestyle fit.
Challenge: Make sure this message is compelling enough to stand out in a crowded market. Consider adding a hook or unique selling point that differentiates your bars from others.
"Made with 100% natural ingredients, our snack bars offer a delicious and nutritious option without the guilt."
Insight: Emphasizes natural ingredients and health benefits.
Challenge: Provide specific examples of what “100% natural” means and how it impacts health. For example, mention specific ingredients or the absence of common allergens.
"Whether you’re at the office, hitting the gym, or just need an energy boost, our snack bars provide satisfaction and joy."
Insight: Targets multiple scenarios where your snack bars would be used.
Challenge: Ensure the benefits align with these scenarios. For example, if targeting gym-goers, highlight protein content or recovery benefits.
Challenge: This could be made more impactful by incorporating a call-to-action or a more memorable tagline.
Refinement Suggestions
Differentiation: What makes your snack bars different from others? Are they gluten-free, high in fiber, or have a unique flavor profile? Highlight these features.
Proof Points: Include testimonials, endorsements from nutritionists, or certifications to build credibility and trust.
Engagement: Use engaging visuals and content. Consider short videos or social media content showing how the snack bars fit into a busy day.
Sampling: Offering samples or trial packs could help attract those interested in trying new products.
Pricing and Promotions: Ensure that pricing reflects the perceived value and consider introductory offers to attract first-time buyers.
By addressing these considerations, you can better tailor your campaign to resonate with your target audience and effectively communicate the benefits of your organic snack bars.
Well, if you feel like all of these are kinda tough, AI can help you write prompt for itself.
Please help me write a detailed prompt for ChatGPT. The goal of the prompt is to instruct the chatbot to write a business plan, similar to what a product or project manager has to write to clarify new projects to their teammates and their bosses. I want the prompt to use the latest, most advanced prompt engineering techniques to accomplish the task.
This often yields a good starting point, if you have no idea how to structure your prompt to get best result.
Prompt Chaining
Prompt chaining is a powerful prompt engineering technique that breaks down complex tasks into a series of subtasks, with the output of one prompt serving as the input for the next.
This approach puts you, the human, firmly in the driver's seat, guiding the AI through a series of steps to achieve your desired outcome. You'll be reviewing AI's outputs, select what to keep, and take that information as input to the next step.
At each step, you might use CoT to make decision or use Fact Grounding to shape the AI’s thinking. Combine different techniques to achieve a better deliverable.
Key Lessons Learned
Chain-of-Thought (CoT) prompting is a powerful technique that asks LLMs to break down complex problems into a series of logical steps, significantly boosting their performance on reasoning-based tasks.
By prompting the AI to critically examine your ideas, you can uncover blind spots and strengthen your decision-making.
You can ask AI to write its own prompt when you can't think of a prompt to write!
Mastering a diverse range of master-level prompting techniques, from CoT to self-prompting and prompt chaining, empowers you to do so much more with Generative AI!