In recent years, the somatosensory technology has been used widely in the game industry. Moreover, it is also used widely for the purpose of rehabilitation, motion capture, input/output interfaces, and so on. Meanwhile the development and application of VR and AR have also become a hot trend. In many scenes of virtual reality environments or movies, a large number of plants often appear to present a natural landscape. In the field of Computer Graphics, Lindenmayer system or L-system for short is the mainstream method of simulating the growth of plants. The L-system is a parallel rewriting system which consists of axiom, the number of iteration, angle and production rules. In this paper, we integrate the motion-capture technique of Kinect 2, the plant growth simulation of L-system, and Unity to implement a somatosensory Edutainment System. This system provides users interesting and interactive experience of growing plants in real-time. The user can swing his/her body to control the virtual tree growth in the beginning. After that, the virtual tree will swing its branches as user did, just like the Ents in the fantasy world. Finally, users can wear HTC VIVE HMD to observe their own generated trees. We look forward to increasing users’ awareness and care about the environment through our system.
Reference
H. Miyazaki, Tonari no Totoro. Tokyo, Japan: Tokuma Shoten, 1988.
Z. Wu, M. Zhou, X. Wang, X. Ao, and R. Song, “An interactive system of modeling 3d trees with ball b-spline curves,” in Second International Symposium on Plant Growth Modeling and Applications, Beijing, China, 2006
K. Xie, F. Yan, A. Sharf, O. Deussen, H. Huang, and B. Chen, “Tree modeling with real tree-parts examples,” IEEE Transactions on Visualization and Computer Graphics, vol. 22, no. 12, pp. 2608–2618, 2016. doi: 10.1109/tvcg.2015.2513409
Microsoft, “Kinect for windows sensor components and specifications,” n.d. [Online]. Available: https://goo.gl/ygFgaQ
Techbang, “The body is the controller. microsoft kinect how to do it,” 2010. [Online]. Available: https://goo.gl/h1W6iz
J. Sissing, N. N. Dlamini and K. Johnston, “Using m-commerce to achieve strategic objectives in south african retail organisations,” Journal of Applied and Physical Sciences, vol. 3, no. 1, pp. 7–16, 2017. doi: 10.20474/japs-3.1.2
Zouxy, “Kinect development study notes (a) kinect introduction and application,” 2012. [Online]. Available: https://goo.gl/ysespr
H. Jiawei, X. Zhiguo, H. Lingeng, X. Ying, L. Nianfeng, and S. Reika, “A special edutainment system based on somatosensory game,” in 6th IEEE International Conference on Software Engineering and Service Science, Beijing, China, 2015.
S.-T. Chen, Y.-G. L. Huang, and I.-T. Chiang, “Using somatosensory video games to promote quality of life for the elderly with disabilities,” in Fourth International Conference on Digital Game and Intelligent Toy Enhanced Learning, Takamatsu, Japan, 2012.
P.-F. Wu, M.-J. Huang, and N.-W. Chang, “The learning experience of fine art by somatosensory game device,” in Fifth International Conference on Service Science and Innovation, Paris, France, 2013.
P. Prusinkiewicz and A. Lindenmayer, The Algorithmic Beauty of Plants. New York, NY: Springer Science & Business Media, 2012.
K. J. Mock, “Wildwood: The evolution of l-system plants for virtual environments,” in IEEE International Conference on Evolutionary Computation Intelligence, Nagoya, Japan, 1998.
F. Valladares, S. Matesanz, F. Guilhaumon, M. B. Araújo, L. Balaguer, M. Benito-Garzón, W. Cornwell, E. Gianoli, M. van Kleunen, D. E. Naya et al., “The effects of phenotypic plasticity and local adaptation on forecasts of species range shifts under climate change,” Ecology Letters, vol. 17, no. 11, pp. 1351–1364, 2014. doi: 10.1111/ele.12348
Y. Manabe, S. Kawata, and H. Usami, “A pse for a plant factory using l-system,” in 7th International Conference on Computing and Convergence Technology, Seoul, Korea, 2012.
M. Xueqiang and L. Hong, “Research on an generalized l-system method,” in International Symposium on Information Technology in Medicine and Education, Guangzhou, China, 2012.
Y. Sun, Y. Liang, and Q. Wu, “Visualization of plant growth based on l-system,” in World Automation Congress, Madrid, Spain, 2010.
G. Kurubacak and H. Altinpulluk, Mobile Technologies and Augmented Reality in Open Education. Pennsylvania, PA: IGI Global, 2017.
K. Guan, “The research of the improved 3d lsystem and its application in plant modeling,” in IEEE Conference on Cybernetics and Intelligent Systems, Chengdu, China, 2008.
L.-H. Chen, T.-H. Lee, C.-Y. Sun, and H.-M. Hung, “A somatosensory edutainment system based on plant growth simulation of L-system,” International Journal of Technology and Engineering Studies, vol. 4, no. 3, pp. 86-94, 2018.
