Chatbot Evaluation Study

Are you a farmer or agricultural professional looking for tools to help with your everyday tasks? We invite you to participate in a research study evaluating AI-powered chatbots designed to provide agricultural information and assistance.

What is this research about?

We are conducting a study to understand how well AI chatbots can assist farmers with their daily work. You will be using two different chatbot applications—one specifically designed for agriculture, and the other a well-known general-purpose chatbot—and answering a series of questions. Your feedback will play a critical role in developing a better assistant for farmers like you!

Why participate?

Influence the development: Your participation will help in determining the usefulness and value of these technologies and improve their effectiveness.
Easy participation: No prior technical experience is required. You will only need a smartphone (Android, iPhone) and willingness to use the chatbot app and provide your feedback.
Valuable insights: Your experiences will help guide the future of AI for farming and make agricultural tools that are tailored to the specific needs of farmers.

What will you be asked to do?

Use two different chatbot applications.
Interact with each chatbot using typical agricultural related questions.
Answer short feedback survey based on your experience and thoughts.

Who are we looking for?

Farmers or agricultural professionals involved in agriculture.
Individuals with access to smartphones (Android, iPhone, or computer).
People interested in exploring new tools and technologies for farming.

How to participate?

Please complete our short registration form (Scan the QR code below or click on the link to register): https://forms.gle/SmqdP5kASfANb7CR9 QR Code for registration

Try Our Chatbots

Please try the chatbots to answer as many questions as possible on Google Form.

🤖 Chatbot 1: Farmer.Chat
An AI-powered assistant designed to help farmers with crop management and agricultural practices.
Available on:

📱 Android (Click here to download)

🤖 Chatbot 2: My.Chat
A general-purpose AI chatbot designed to answer a variety of questions, including farming-related queries.
Available on:

🍎 Apple iOS (Click here to download)
🌐 Use the chatbot on the bottom-right corner of the screen

How to Use Chatbots:

Getting Started:
1. Log in to your chatbot (Farmer.Chat, My.Chat, ChatGPT) after downloading the apps.
2. Type your question into the chatbot’s text box.
3. Press Enter or Send to submit your query.
4. Review the chatbot’s answer and ask follow-up questions if needed.
5. Copy your question and repeat it on the other chatbots in this study.
Example Prompts:

Which crops are supported by CropManage?
What's the harvest frequency of [insert crop name] Walnut?
What are the recognized growth stages for [insert crop name] almonds?
Which soil types are available in CropManage?
Tell me more about the [insert sprinkler name] Fan-Jet PCND PCND-4 micro sprinklers
Can I see the difference in rainfall data among local stations?
How do I export data from a ranch in CropMange?

We would love to hear your thoughts or feedback on how we can improve your experience! Please fill the Google Form. If you want to provide feedback directly please email us at: pgpt@ucdavis.edu