Ahead last week, behind this week.
Preliminary Results & Graphs:
(Most of my charts/tables will not upload on blogger--see presentation in class!)
[Hypotheses]
1. Mobile device users will use more category heuristics than large-screen users.
2. Mobile device users will be more satisfied with their selection because they had fewer choices.
3. Large-screen users will perform better, as rated by independent raters.
{still to be determined}
4. Mobile device users will feel like they need more time more than large-screen users.
What I need to do:-Run significance tests
-Finish designing format for expert reviewers
-Have my experts rate the selections
-Analyze results from experts & other data in this new context.
Looks like it's coming along.
ReplyDeleteThe second plot you've included here seems to be more or less what you were expecting, at least in terms of the difference. Since it looks like your subjects on average aren't getting near the five minute mark, what can you conclude about the differences, if they do turn out to be significant? In other words, will you be able to conclude anything about the mobile subjects needing more time, as opposed to just enjoying browsing longer?
Also, the x-axis seems to have two labels on that plot. Is the number-of-seconds one misplaced?
I'll be interested to hear what you have to say about the first plot in class today. Very strange!
I saw your results last week and they were kinda interesting. In my project, currently I am incorporating ways to make sure the order in which images/videos are presented to the subjects is random or balanced. In your case, was the order in which the shirt and dresses displayed randomized? Either way, would be nice to see how it affects the results.
ReplyDeleteI am looking forward to seeing more results after you get the ratings from the experts too!Good luck!
Look solid.
ReplyDeleteHow much data is this out of? How many users? How many dresses and shirts?
Interesting how "1. Mobile device users will use more category heuristics than large-screen users." gives some strange data. Is it really dependent on the product? What if it was coke or a flight or some other product?
Looks good!
ReplyDeleteFor the average number of search heuristics, the average seems to always be below 1, suggesting that many people did not use any search heuristics at all. From the class discussion, search heuristics are just the number of sub-categories / filters a user used I think... Maybe this is not the best measure to compare users by, especially since you said mobile users almost always chose a choice on their initial page. Maybe a more telling metric would be how many pages they navigated to in total. A filter operation would lead them to a new page, so this would get counted in the metric, but also just paging through your choices would get counted as well. Then you would expect that mobile users navigate to much fewer pages than desktop users.
As for the graphs in general, I don't think its very useful to compare dress vs. shirt. The useful comparisons are between mobile vs. desktop within dress and shirt, so the bar graphs could be laid out in this way, with mobile vs. desktop bars side by side for each of the two groupings of shirt and dress.
I think, most of your hypothesis come from information foraging theory which is based on the assumption that, when searching for information, humans use "built-in" foraging mechanisms that evolved to help our animal ancestors find food.
ReplyDeleteThe number of heuristics in your case will be directly dependent upon users estimate of how much useful information they are likely to get on a given path. When users no longer expect to find useful additional information, they will move to a different information source.
In desktop case, people will take less time to get their expected result because because it uses less costly scatter/gather model. On mobile phones, since only a small number of results can be displayed, the cost of foraging (time and quality of results) increases.
Your results completely validate this theory. However, it is interesting that there us no clear correlation on users' satisfaction level for two different mediums. People using desktops suffer from "paradox of choice" but it doesn't seem very clear with the experiment result (the shirt selection data).