A Comparative Verification of Design Ordering Methods using Reader's Feeling for Document Production Outsourcing Services

  • Kazuo Shibuta Tokyo Institute of Technology
  • Kunihiko Higa Kwansei Gakuin University
Keywords: design, outsourcing, crowdsourcing, ordering method


We showed that there are three levels of production purpose, reader's feeling and design specifically as an ordering method when requesting design work. It was statistically confirmed that the appropriateness and the easiness of understanding improve when the order content includes reader’s feeling. In particular, it was recognized that appropriateness would be improved if the reader's feeling instruction was given without the production purpose instruction. Furthermore, appropriateness decreased when instructing production purpose and design at the same time. As a result, it is considered that the inclusion of reader’s feeling in the content of the order has improved the evalu-ation of the worker for the ordering method.


Fuji Xerox Co., Ltd., Dec. 2014; http://www.fujixerox.co.jp/solution/gs/.

J. Howe, “The Rise of Crowdsourcing,” Dec. 2014; http://archive.wired.com/wired/archive/14.06/crowds.html?pg=4&topic=crowds.

“A Survey on Usage of Crowdsourcing in Japan,” Y’s Staff Co., Ltd. report, Small and Medium Enterprise Agency, 2013 (in Japanese).

A. Kittur, B. Smus, and S. Khamkar, R. E. Kraut, “Crowdforge: Crowdsourcing complex work,” Proceedings of the 24th annual ACM symposium on User interface software and technology, 2011, pp.43-52.

D. Chandler, and A. Kapelner, “Breaking monotony with meaning: Motivation in crowdsourcing markets,” Journal of Economic Behavior & Organization 90, 2013, pp.123-133.

C. Eickhoff, and A. P. d. Vries, “Increasing cheat robustness of crowdsourcing tasks,” Information retrieval 16(2), 2013, pp.121-137.

A. Kittur, E. H. Chi, and B. Suh, “Crowdsourcing user studies with Mechanical Turk,” Proceedings of the SIGCHI conference on human factors in computing systems, 2008, pp.453-456.

H. Jeffrey, and M. Bostock, “Crowdsourcing graphical perception: using mechanical turk to assess visualization design,” Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2010, pp.203-212.

Lancers Inc., May. 2020; http://www.lancers.jp/.

CrowdWorks Inc., May. 2020; http://crowdworks.co.jp/.

Announcement of "Cloud Sourcing Ordering Experience" for SMEs developed by the Consortium for Promoting Crowdsourcing Utilization, " May. 2020; https://www.japan-telework.or.jp/oshirase/75.html.

N.P. Suh, “Axiomatic Design of Mechanical Systems,” Journal of Mechanical Design and the journal of Vibration and Acoustics, Transactions of the ASME, Volume 117, June 1995, pp.1-10.

Yoshiyuki Matsuoka, “Multispace Design Model: Toward the Construction of the Framework for Design Science,” The 55th Spring Seminar of Japanese Design Society Conference summary collection, 2008 (in Japanese).

H. Yanagisawa, T. Murakami, K. Ohtomi, and R. Hosaka, “Quantification method of product emotional quality considering its diversity (application to quantification of emotional quality in product sound design),” Transactions of the Japan Society of Mechanical Engineers, Series C, Vol.74, No.746, 2008, pp.2607-2616 (in Japanese).

Takeshi Tanaka, Masakazu Fujimoto, Tomomi Urushihara, “On the evaluation scale for document expression quality,” Proceedings of the 42nd National Conference of Information Processing Society of Japan, the first half of 1991 (3), 1991, pp. 331-332 (in Japanese).

R. E. Petty, J. T. Cacioppo, and D. Schumann, “Central and peripheral routes to advertising effectiveness: The moderating role of involvement,” Journal of consumer research, 10, 1983, pp. 135-146.

“What is the image scale | NCD-WEB | Japan Color Design Research Institute for Color Psychology, Consumer Research, Trend Analysis,” Japan Color Design Research Institute Inc., May. 2020; http://www.ncd-ri.co.jp/about/image_system/imagescale.html.