'Prompt Engineering for ChatGPT' course note: Part 2 What are Prompts

 What are prompts


  • A prompt is a cue, a reminder to let LLVM remember something to say.
  • A prompt can influence not only the current question, but also the future responses.
    • Example: "From now on, when I ask a question, suggest a better version of my question and ask me if I would like to use it."
  • You can provide additional info to help LLM analysis.
    • Example: For ChatGPT 3.5 not knowing online info, provide new articles for it to parse answer.

Intuitions behind prompts

Based on training data and prompts, LLM predict the next word continuously.

  • A strong pattern in training data can be a trap. We need to add specific words to escape or get into a trap.
    • For example, "Mary has a little" is almost certainly to be followed by "lamb". If we don't want go into this trap, we can add word to skip it, like "Mary has a little microscopic".
  • The prompt can provide pattern for output. It prompts LLVM to follow the pattern.
    • For example:
Recommend 10 books:

--------------------
Title: <Title>
Author: <Author>
Summary: <Summary>

Everyone can program with prompts

Given LLM a rule to follow, it can generate output following the pattern.
For example: Generate examples in the requested CSV format (NAME, AUTHOR, SUMMARY).

Comments

Post a Comment

Popular posts from this blog

'Feynman's study method' reading note: Part 1 The essence of learning

 The essence of learning Traditional learning: input-oriented, measured by standard tests, driven by teachers. Output-oriented learning: Focus on output, Emphasize current impact, driven by teaching and usage. The essence of learning is output. Not the knowledge itself, but the use of the knowledge based on your situation. Five steps of output-oriented learning: establish a learning object, understanding the knowledge, teaching the knowledge, review, simplify. Establish a learning objective The object is dynamic, adjustable. Study should be easy, using a few understandable steps to make great progress. Use the limited time resource effectively on learning the selected object. Absorb it. To establish a learning object, ask yourself a few questions in two degrees: For the current situation: 1. What's the main problem? 2. What's the shortage? 3. How can I address shortcoming, how hard is it? 4. Split steps? For the future development: 1. What will I be interested in? 2. What are t...
Read more

‘Wheeled Autonomous Mobile Robot Programming in Practice’ reading note: Part 1 Wheeled Robot Basics

'Wheeled Autonomous Mobile Robot Programming in Practice' is the title of a book by Li De that was published in 2022. Wheeled Robot Basics Wheeled Robot moves by wheels, driven by electric motors, controlled by controllers like STM32 or Raspberry Pi. It needs electric motor drivers like L298N. Design a wheeled robot: 1. Planning: uses tools like FreeMind to make clear requirements (Robot dimensions, functions, work environments, special requirements). 2. Steering structure:    a. Differential steering: use different speed on left and right motors to turn.    b. Independent servo steering: use a servo to change direction of motors.    Differential steering is prefered: simple, can in-place turn.    Need a odometry motion model (based on the speed of the motors) to calculate current pose (x, y, θ).    Needs IMU sensor to calibrate. 3. Electric motor selection    12V power. To support odometry motion model, needs speed measur...
Read more