Skip to main content

Premise: If we want to train people to leverage the AI tool, should we be writing cards to be read by the AI tool and not a person?

Is anyone else testing out the best ways to write information for the tool to read and present to the asker?

Test 1: Holiday Schedule - spreadsheet
I used a spreadsheet format with rows and columns on a card titled “ Company Holiday Schedule.”
Column A  - Holiday names
Column B - Dates

When asking Answers - 

“When is the next company holiday?” The system could not provide an answer. It did point me to the right card.

“When is Memorial Day?” The system could not provide an answer.

“Can I have a list of company holidays?” The system could not provide an answer but suggested the right card.

Conclusion - The AI tool struggles to properly read spreadsheets.

Test 2: Holiday schedule - List

I ditched the spreadsheet, and wrote the holidays in a list, including dates through 2024. This is uglier to view as a reader, but I hoped the AI tool could read it more effectively. 

Memorial Day - May 29, 2023
Independence Day - July 4, 2023
Labor Day - September 4, 2023

When asking Answers - 

“When is the next company holiday?” The system could not provide an answer. It did point me to the right card.

“When is Memorial Day?” The system answered with “Memorial Day -  May 29, 2023 and May 27, 2024

“Can I have a list of company holidays?” The system listed all holidays as written.

Conclusion - Lists are more effective than spreadsheets.

Test 3: Holiday List Natural Language

I updated the list so that every holiday was readable in natural language. This is by far the ugliest card to read, but the goal was to write something that would appear best in an AI query.

The list looked like this - 

  • Memorial Day is observed on Monday, May 29, 2023.
  • Independence Day is on Tuesday, July 4, 2023.
  • Labor Day takes place on Monday, September 4, 2023.
  • Thanksgiving is celebrated on Thursday, November 23, 2023.
  • The Day After Thanksgiving falls on Friday, November 24, 2023.

 

When asking Answers - 

“When is the next company holiday?” The system responded first with “Memorial Day is observed on Monday, May 29, 2023”. After an hour, it responded with, “New Year's Day falls on Monday, January 2, 2023.”

“When is Memorial Day?” The system answered with “Memorial Day is observed on Monday, May 29, 2023.”

“Can I have a list of company holidays?” The system listed all holidays as written.

Conclusion: The system can better read the natural language, but still struggles to put dates in relation to other dates and times.

 

 

@Jimmy Miller - Can I inquire if you’ve tested this with your emoji searching and if so, were the results as favorable using natural language than the tabled information?

Original post: Writing Content Intended to be Read by AI


@Gregg Frank  - So far, Answers won’t recognize emoji. This is a little frustrating, but I’m testing a new method - a return to ascii art.

Example: replacing 😀 with :)

This seems to be a bit more recognizable by the language processor, but is more difficult for the end user to decipher apart from Answers.

TLDR - This tool doesn’t like emoji in any format.



 


Update - 

Test 4 - Hide the natural language in a dropdown menu

I “hid” the natural language list in a dropdown menu at the bottom of the card and put a user friendly spreadsheet in the card as an image.

The theory was that a user could access the card, and get the information they want from the image without seeing the natural language mess intended for the AI.

Natural language hidden in dropdown menu


 

It’s ugly, but the computer can read it



When asking Answers - 

“When is the next company holiday?” The system responded first with “Memorial Day is observed on Monday, May 29, 2023”. Still struggling with time and relationships

“When is Memorial Day?” The system answered with “Memorial Day is observed on Monday, May 29, 2023.”

“Can I have a list of company holidays?” The system listed all holidays as written.

Conclusion: Answers will read the dropdown menu successfully! If we can find a way to hide natural language in metadata, and show readers the more visibly appealing data when searching for specific cards, then this tool becomes INCREDIBLE


Hey @Jimmy Miller ! Thank you for sharing your breakdown and examples of how Answers work in your testing. Just wanted to share some more context that might help as you’re experimenting:

  • The technology powering Answers is not aware of the current date or time, so asking questions about the next holiday or next event won’t result in an accurate answer. We don’t yet have a solution to this challenge, but one workaround could be including today’s date in the question like “What’s the next company holiday after June 7, 2023?”
  • Card content is currently passed to Answers as plain text, but an improvement is coming soon to include markdown context like links, bullets, table formatting, etc. In your first example using a table, the table formatting is currently being removed when the card content is passed in, so Answers might not understand the relationship between all the text in the table. It’s possible this will work much better once we support markdown formatting. No promises since we are still working on it, but we will share an update once that change is out!

To your larger question about whether we should be writing cards to be read by the AI tool and not a person, our current position is that teams shouldn’t have to change the way they write content for Answers. By collecting examples like the ones you shared above, we will learn more about where the AI has challenges processing current card content and where we can make improvements. In the coming weeks, we will be adding a way to submit feedback directly on individual Answers so we can collect more feedback like this at scale. 

Let me know if there’s any more context that would be helpful as you’re using Answers and thinking about it’s impact on your workflows. Always happy to share!


This is very helpful!

Thank you so much for the insight. 

I’ll keep experimenting and trying to document as best as I can for this community,


@Brad Turner my latest iteration has been a huge success.

I used a PNG to show the information I want my people to see.

The text for Answers is below, hidden in a dropdown markdown. 

It works like a charm. My people get the pretty view, Answers gets the text it wants.

 


Reply