• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to secondary sidebar

IRL Experience Design

  • Best Of
  • My Work
  • About
  • Austin Experiences
    • 60+ Weird Things To Do In Austin
    • The Top 13 Immersive Experiences in Austin, Texas
    • 45+ Unique Things To Do in Austin (A local’s guide)
    • Things to Do in Austin When it Rains
    • 5 Fun & Unique Austin Team Building Activities for Small Teams
    • Austin Halloween Guide
    • Austin Christmas Guide
    • Austin Easter Guide
  • Contact

Experience Design

What’s The Cost Of Testing In The Real World? Of Not?

June 4, 2021

Note: This post was written on 2/3/2021 and posted today.

The Messy Homes Tour was last night.  I think it went well and multiple people wrote to tell me it was fun. Despite testing nearly everything ahead of time, we had some tech hiccups.

Tech issues in meetings seem to be commonplace, both online an IRL, so I want to examine this phenomena.

The MHT was, essentially, a Zoom meeting that was streamed to Facebook Live. To test this, my co-host Rebecca made a fake Facebook event in a Facebook group and streamed a test Zoom meeting to it. It worked. We had already tested all the various Zoom/Manycam/Snapchat configurations we would use as well. Every scenario we could think of was tested. 

But when we tried it live it didn’t work.

Why? 

Because we didn’t test her streaming on the exact same page it would be streaming to live. (The Big Weekend Facebook page). It took a while but eventually we found that we had some permissions issues.

But we shouldn’t have permission issues, I thought. Earlier in the week I realized she would need permission so I sent her an invite to be an admin of my Big Weekend Facebook page.

It turns out that you don’t just make someone an admin on Facebook. You send them an invite and they have to *accept* it.

The invitation was mixed in with the slew of notifications Rebecca sees every day. Most of which are not worth reading. She missed the invite.

I could have checked to see if she had accepted the invite, but since I’m used to things like Google docs, where you send an invite and that’s it, I didn’t know to check. Also, finding the spot to check is nonobvious.

So when we kicked off the show and she tried to stream on the live page, it sent me a notification (buried, of course) that I had to approve her stream. (Because as far as FB was concerned she was not an admin yet). Of course I didn’t know this was an issue let alone to look for how to fix it. 

A typical reaction to this problem might be: “Well, now we’ve learned what to do so we know what to do next time.”

But I think a better response is to ask: “What’s the cost of doing an actual true live soup-to-nuts test?”

The “next time we’ll know” reaction might prevent future instances of this exact problem. But the help it provides doesn’t transfer from this scenario.

The proactive response is far more useful. It gives us a tool we can use elsewhere. Testing soup-to-nuts will find “unknown unknowns”.

We See This All The Time

Not testing the real deal costs us all the time when we take our setup out into the real world:

Their projector doesn’t work with my laptop. 

There’s not enough outlets in this room.

We should have brought that adapter.

Sure, it’s potentially embarrassing to show a livestream test on your Facebook page. But how does that compare to having it not work at all when you do it for real? Weigh the pros and cons of a real-life test vs. controlled environment test.

Posted Under: Experience Design Tags: #MessyHomesTour, #ExperienceIMade

  • « Go to Previous Page
  • Page 1
  • Interim pages omitted …
  • Page 95
  • Page 96
  • Page 97
  • Page 98
  • Page 99
  • Interim pages omitted …
  • Page 189
  • Go to Next Page »

Primary Sidebar

About Me

I make awesome experiences for people. Read More

Search my blog

Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors

See My Favorite Books

  • For IRL XD
  • For Learning
  • For Getting Things Done

@IRL_Experience_Design

instaglogo

Secondary Sidebar

See My 4th of July Event Guide Featuring Independence Day events for over 500 cities!

A cute uncle Sam holding up a paper showing different 4th of july images.

See My Halloween Event Guide Featuring Halloween events for over 1000 cities!

A cute ghost holding a map of Halloween Events

See My Holiday Event Guide Featuring Holiday events for over 1000 cities!

A cute elf holds a map of Christmas and holiday events around the city.

VISIT MY BOUTIQUE IMMERSIVE EXPERIENCE

SEE MY AUSTIN EVENTS WALL CALENDAR

Austin Events and Things to Do 2025 Wall Calendar Cover

Read My Recent Posts

  • More Websites for Fun
  • The Best 4th of July Events Website
  • Bulk Cold Emailing For Beginners
  • IRLXD Update 9/12/2024
  • Eureka Room Update 6/18/2024
  • A Creator’s Trap: Confusing the Joy of Creating with the User Experience
  • Lessons Learned: Don’t fall in love with a challenge that does not need taken on.

  • Contact
  • About
  • Privacy Policy