
Task
Design a mobile app that enables users to impulsively identify and purchase a garment or accessory seen in real life. Design an end-to-end flow covering the experience from the moment of awareness to purchase completion.
My role
Product designer
Use-case
User sees the physical item being worn by a friend or at a physical store (i.e. comparison shopping other stores)
Challenges
I don’t fully understand the visual search capabilities/limitations, so I have to consider a graceful failure of identification.
How is this app better for the user than just searching on Amazon or Google without this app, especially in the case of misidentified items?
Key features
I. Visual Search
Camera “instantly on” and searching when app is launched (i.e. similar to facial recognition in cameras). Alternate input by text / voice
II. Mobile Shopping Search Results Page
One-click purchase (i.e. Amazon). Show "details" page or allow purchase directly from SERP?
Offer receipt and shipping info, like physical receipt.
III. Supporting pages
History of previous searches. Visual history?
Preferences (i.e. payment method, one-click purchase, location, gender, etc.)
Failure pages
Research of other visual search apps

I. Design of visual search
Challenges
How to allow them to “select” an item in the case of multiple items identified? How to overlay information on return results, without creating friction to checkout? Perhaps use other "layered" informational patterns, like Google maps with pins.







II. Design of Mobile Shopping Search Results
Use Amazon and Google's pages as examples

Considerations
Do we have a "details" page view between the SERP and the purchase or allow a purchase directly from the SERP? Probably fewer steps is better.
Visual hierarchy
Create hierarchy for "failed" or "undesired" results with alternatives keeping the user browsing:
1. Hero image for most likely result (quick purchase). Display hero variations (i.e. color)?
2. Display other likely results
3. Display visually similar results
4. App misidentifies the item
5. User wants an alternate item (i.e. less expensive item)
6. Specific categories of items (all men’s large face chronograph watches)
7. Other items users also tend to buy if they view the initial item
8. Text list of alternate results
9. Pagination? Infinite scroll?




