Home > articles > Impressions of FiveSecondTest.com

Impressions of FiveSecondTest.com

Recently, my buddy who I profiled in an earlier blog post, sent me a link to a user-test. Actually, it was a Facebook update that looked like this:

Facebook post with user test link

Here's the User-Test. Give it a go.

The link takes you to a start page shown below:

Test page for the FiveSecondTest.com test

If I would have read this, things would be different.

Because I’m interested in karma points, I became a member of fivesecondtest.com.  I clicked on Start Here and it shows:

5second-test-prompt

Final instructions to the user before the test.

Ah ha! The test tricked me.  I clicked on “Show Image” and was shown a screenshot in my browser window. But the screenshot was too big and I had to scroll back and forth to see it.  I wasted my 5 seconds and blew the test. And then, the screenshot went away and I was asked,”what is the purpose of the website?” and given a text input area.

The prompt was: “Take a look at the website screenshot, and look at the design/colors/text.”  The questions were:

  • What is the purpose of the website?
  • Do you like the color scheme?
  • Is it too cluttered?
  • Is there too much text on the left of the iPhone image?
  • Is the navigation bar easy to understand?

Yep, I didn’t read the instructions. If I had, I would have known to concentrate and look at for 5 seconds. Duh, it’s called fivesecondtest.com! Sometimes, I’m late to the party.

My immediate reaction was, “How can you ask these questions based on viewing the screenshot for 5 seconds?”.  What questions would you ask after only giving the user 5 seconds to view the site and test?  Can you get reliable data based on this type of test? How does the social aspect and the repetitive nature of the tests affect the results?

Now, I’m interested and I decided to do another.

The next test reiterated the 5 second rule in its prompt.  Prompt: “You have 5 seconds to view the image. Afterwards, you’ll be asked a few short questions”  This test asked:

  • What does this company do?
  • What did you think of the layout and design?
  • What stood out most to you?
  • If you were looking for a website, would you continue to go further into the site to find out more?
  • Does the website look professional?

Okay, I’m getting the hang of it now.

I do another one – this one the prompt is, “You are a young woman who regularly purchases beauty products (skin care/cosmetics)”.  And, the questions:

  • How would you rate this page on a scale of 0 (really bad) to 10 (really great) ?
  • Was it clear what the product was?
  • What would you do next?
  • What did you like most on the page?
  • What did you like least on the page?

I saw my buddy on Facebook and we chatted about it.  He said, “You get a lot of BS answers because people really don’t have incentive to answer thoughtfully.”

He also gave me an idea of how it works using the ‘community option’ service level of fivesecondtest.com. You get 30 responses for free for signing up.  And then, for every test that you take,  your test can be given. Paid plans start at $20 (100 test responses) a month and go to $200 (1000 responses) a month.

To summarize my opinions, I feel that this type of test could be a part of a good user testing plan. I was not impressed with the questions in the three tests that I took. Following the G.I.G.O ( garbage in garbage out ) principle, bad questions will yield bad answers. I doubt that the questions / answers will yield any actionable information beyond confirming pre-existing assumptions about the sites. However, I feel that a well-designed question that takes into account the nature of the test could produce actionable results. question should be general and open-ended. They should deal with impressions and feelings, rather than specifics.

Finally,taking my opinions into account, here are my top five questions from the 15 I saw:

  • Does the website look professional?
  • What stood out most to you?
  • What did you like most on the page?
  • What did you like least on the page?
  • Was it clear what the product was?
Categories: articles Tags: ,
  1. Ben Snyder
    September 10, 2011 at 6:57 pm

    Why are those your “top 5” questions? Are those the questions you thought were the most likely of the questions that you saw to result in actionable information? What kind of feedback would you expect to give?

    Did you give thoughtful responses to the questions? Do you plan on uploading a design to get feedback?

  2. Newman
    September 11, 2011 at 12:16 pm

    Great questions, Ben.

    These five questions best met my criteria: producing actionable results, general (not specific), open-ended and dealing with impressions. Questions should not deal with specifics because of the short time the user has the focus.

    With a 5 second test, I would only expect to get general impressions and feelings. I am sure that there are better questions than this.

    The real question is, “will I use and recommend five second test.com?”. To be honest I’m lukewarm on a recommendation. Perhaps after doing my own tests, I may feel different. I do think it’s worth 20 bucks to test it out on 100 testers

  1. September 12, 2011 at 7:55 pm
  2. September 30, 2011 at 6:25 pm
  3. April 13, 2016 at 9:20 pm

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: