Uncle Sam Urges You to Unleash Your Inner Sherlock on Artificial Intelligence Bloopers

“The US Government Wants You—Yes, You—to Hunt Down Generative AI Flaws”

“In most AI research, scientists focus on having machines perform a narrow task, like recognizing an object in a photo or translating a language. Generative AI, though, doesn’t just execute a task—it has a goal and must figure out how to achieve it.”

Well, well, isn’t that something? Scratch that, it’s not just something. It’s the stuff that science fiction thrillers are made of. Machines are no longer just playing amongst the lines; they’re coloring outside of them. Instead of merely following commands like ‘fetch the tennis ball’ (like an obedient robot dog), Generative AI is being challenged to plan and execute projects like building a tennis court. Talk about an upgrade.

But just how good are these systems at doing what they are designed to do? Of course, the National Institute of Standards and Technology (NIST) wants to answer this question. Well, actually, they want the public to answer it. Yes, that’s right, folks. NIST has decided to run a crowdsourced contest, setting you, the audience, on this so-called generative AI for some intense Red Teaming.

Red Teaming is basically a friendly ‘once-over’ by another team in the tech world, commonly executed to identify flaws or vulnerabilities before a product goes to the market. However, in this unique context, ‘Red Team’ means that regular netizens like you are being invited to play this unpredictable game of cat and mouse with the brand new, evolved AI creations.

So, to all the tech enthusiasts, AI aficionados, and brave-hearted netizens out there, here’s your chance to put these intelligent machines through their paces. Help NIST determine whether these AI systems truly display what they term as ‘humane intelligence’. Or, as we like to call it, ‘Can a machine actually replicate human-like decision-making processes?’

This isn’t a simple question of bots winning a game of chess anymore. It’s about whether these systems can make judgements and decisions on par with humans, despite unfathomable variables, inconsistencies and uncertainties. You know, like selecting the perfect paint color for a room despite differing light sources, or ordering dinner while juggling dietary restrictions, personal preferences, and the budget.

Welcome to the era of Generative Artificial Intelligence. It’s the dawn of a new day in AI research. Or is it? Participate in the Red Team Contest and be the judge.

Read the original article here: https://www.wired.com/story/nist-humane-intelligence-generative-ai-red-team-contest/