大屏幕电视，作为客厅中的家庭共享娱乐设备，除了观看电视/视频之外，互动/游戏娱乐也是重要的内容。电视上的互动和电视游戏，在国内外的表现有很大的区别。
电视游戏(TV Game/Console Game)，指的是使用电视作为显示设备来玩的电子游戏。在国外，尤其是欧美日国家，游戏主机的普及率较高；玩家可以稳定地获得高质量游戏。由于购买一款正版游戏往往需要付出相当于人民币几百元的钞票，玩家倾向于深度地玩每一款购买的游戏。
而在国内，由于游戏主机售价普遍较高，再加上正版游戏的费用，导致游戏主机在国内的销量和普及率处于很低的状态。所以在国内家庭客厅，主要显示设备是大屏智能电视。数据显示，2015年国内电视零售销量为4674万台，其中智能电视穿透率73%。所以国内的电视游戏指的是运行在智能电视上的游戏，且多为免费网络游戏，用户无需额外付出主机和单个游戏的购买费用（中国玩家长期习惯于网络游戏和免费获得的游戏）。
从操控设备来看，电视游戏除了传统的遥控器和Joystick外，往往还加入了摄像头作为全新的体验和卖点。
游戏主机摄像头
国外游戏主机使用的摄像头代表当属Xbox系列的Kinect体感摄像头和PS4 Eye摄像头，可用于体感游戏、人物识别、语音交流等。
Xbox one Kinect 2 Camera
3D摄像头可以捕捉人的骨骼信息，骨骼运动信息通过动作识别算法，用于控制游戏中角色的肢体动作，所以运动类和舞蹈类游戏非常适合于3D摄像头。而且摄像头可以识别多人的骨骼运动，因此客厅中多个玩家可以一起游戏，特别适合全家人一起的娱乐。
Kinect Sports rivals
Kinect Dance Game
智能电视上的摄像头
2D摄像头
可以用于视频、语音聊天，简单的2D手势控制，简单的2D游戏控制
典型代表：三星SmartTV。通过手势用户可以自由的切换频道，调节音量以及返回之前界面等功能。同时，该功能还允许用户通过手掌的伸展和紧握实现画面的放大和缩小。还包含语音控制功能，更换频道时用户只需要说出频道的号码即可。
笔者体验过三星SmartTV上的语音控制功能，识别度高，可用性比较强；而手势控制，由于2D摄像头的控制准确度不足，操作界面相当吃力，远不及使用遥控器来的简单方便。
三星SmartTV 摄像头控制
3D深度摄像头
可以用于3D体感游戏操控、人物
典型代表：乐视超级电视的3D摄像头
从上面搭载的“运动加加”游戏来看，游戏的反应速度较快，控制相对精确。这款3D摄像头售价七百多人民币，如果能加入更多家庭互动娱乐内容，相信可以卖的更好。
乐视3D摄像头游戏
下一代的3D摄像头技术，AR增强现实
我们前面讲到的3D摄像头，都是直接连接在智能电视之上。虽然可以调节方向朝向，可移动的范围还是十分有限。所以用户和智能电视摄像头的互动，是面朝着摄像头，活动范围是电视前的空间。那么可交互的主体，只能以人的动作为主。
如果我们扩展下思路，其实家里还有很多可互动的物体，有家具、宠物、玩具、各样好玩的东西。摄像头是否变成可以移动，用来扫描这些物体，是这些物体进入电视游戏中呢？
有两个办法，一是摄像头和电视是无线连接的，可以拿着到处用；二是把摄像头做到移动设备上，手机或者平板，利用移动设备的计算能力，可以即时在移动设备的屏幕上看到效果；同时利用wifi或者bluetooth和电视做连接，将运算结果传送给电视。
当然由于电视屏幕是固定显示设备，不能够像头盔和眼镜一样跟随人的运动而变换场景，所以不能做到完全真实的AR或者VR感受。能做到的是扫描环境中的物体，用于构建虚拟游戏中的场景，让用户定制游戏场景，让每个用户的体验，每次游戏的体验都不相同。例如可以让家庭中厨房的桌面变成赛车的赛道。
AR增强现实游戏包括：
- 真实的环境、物体变成游戏场景
- 虚拟的游戏元素（人物、车）在游戏场景中活动，与游戏场景中的物体互动
桌面赛车场景
Intel 实感摄像头RealSense R200
Intel 新一代的实感摄像头R200可用于真实环境的扫描和还原，将扫描环境的3D物理线框数据和表面颜色数据给到游戏使用。
游戏拿到3D环境数据后，需要重建虚拟的显示数据，包括物体的网络模型，重新贴图和计算光照，并构建虚拟世界的物理碰撞属性。然后在其上加上虚拟的游戏物体，比如车辆、角色和游戏中的武器等等。玩家可以在平板上体验游戏，为了更大的屏幕体验，可以把游戏场景数据传送到电视上，在大电视屏幕上更舒服地来玩。
根据现实世界构建游戏场景，对于游戏的设计，提出更多挑战：
- 无法预知的游戏场景，游戏的故事目标如何设定？
- 游戏场景多样化，对于游戏中可操控的物体的物理运动稳定要求更高
结语
电视屏幕作为家庭娱乐的中心，在国外以连接游戏主机为主，在国内以智能电视为主要表现形式。2D和3D摄像头在现在，是电视屏幕有用的操作外设，可用于语音/手势控制、3D运动/舞蹈游戏等。在未来，具备3D扫描功能的摄像头将为电视游戏提供更多的可玩性和全新的体验。
Link Copied
An unusual post. *smiles* It seems to be a posting of a Chinese article about motion-sensing cameras like RealSense and Kinect. Seeing as it doesn't seem to be an advert for something, I'll post a translation.
*********
Big-screen television, as a shared living room home entertainment devices, in addition to watching TV / video outside, interactive / video games is an important content. Interactive television and video games, at home and abroad show a big difference.
Video game (TV Game / Console Game), refers to the use of television as a display device to play video games. In other countries, especially in Europe and America countries, higher game console penetration; players can stably obtain high-quality games. Since the purchase of a genuine game often equivalent to RMB several hundred dollars to pay bills, players tend to play with the depth of each purchase of a game.
In China, due to the generally higher price of game consoles, plus the cost of genuine game, leading game console sales and penetration in the country at a very low state. So the family living room at home, the main display device is a big-screen smart TV. Data show that in 2015, domestic retail sales of 46.74 million TV sets, including smart TV penetration rate of 73%. So the domestic video game means that run on smart TV games, online games and more for free, users do not need to pay extra hosts and the purchase price of a single game (Chinese players long accustomed to online games and free games available).
From the control device, the video game in addition to the traditional remote control and Joystick, but often also joined the camera as a new experience and a selling point.
Consoles camera
Webcam representatives abroad undoubtedly Xbox game console to use the series Kinect somatosensory camera PS4 Eye camera and can be used to somatosensory game, character recognition, speech exchanges.
Xbox one Kinect 2 Camera
3D camera can capture the human skeleton information, skeletal motion information through action recognition algorithm for controlling the game in the role of body movements, so sports and dance game is well suited for 3D camera. And the camera can recognize people's bone movement, so multiple players can play in the living room together, especially for the whole family entertainment.
Kinect Sports rivals
Kinect Dance Game
Smart TV Camera
2D camera
It can be used for video, voice chat, a simple 2D gesture control, a simple 2D game control
Typical: Samsung SmartTV. Through gestures the user can freely switch channels and adjust the volume before returning interface and other functions. At the same time, this feature also allows users to stretch and palm grip zoom in and out of the screen. Also includes voice control function, the user need only say changing channels to channel numbers.
I experienced voice control features Samsung SmartTV on identifying high availability relatively strong; and gesture control, due to lack of control accuracy 2D camera, the user interface is quite difficult, far less than using the remote control to the simple and convenient.
Samsung SmartTV camera control
3D depth camera
It can be used for 3D somatosensory game control, character
Typical: music as a super TV 3D camera
From the above, equipped with "movement Gaga" game, the game of reaction speed, control is relatively accurate. The 3D camera priced at more than seven hundred yuan, if the family can add more interactive entertainment content, I believe you can sell better.
Music as 3D camera Game
The next generation of 3D camera technology, AR Augmented Reality
We've talked about the 3D camera is connected directly on the smart TV. Although you can adjust the direction toward the movable range is very limited. Therefore, user interaction and intelligent television camera, is facing the camera, the scope of activities is space in front of the TV. Then the body can interact only with people of the main action.
If we expand the next thought, in fact, there are many home can interact with objects, furniture, pets, toys, all sorts of fun things. If the camera can be moved into, used to scan these objects, these objects into the video games it?
There are two ways, one TV camera and a wireless connection, you can use everywhere held; the second is to do on a mobile device camera, mobile phone or tablet, use the computing power of mobile devices, instantly on the screen of the mobile device see the effect; while taking advantage of wifi or bluetooth connection and television do to transfer the calculation result to the television.
Of course, because the TV screen is fixed display device, such as a helmet and glasses can not follow the same movement of people transformation scene, we can not be completely true AR or VR experience. Can do is to scan the objects in the environment for building virtual scenes in the game, allowing users to customize the game scenes, so that each user experience, every time the game is not the same experience. For example, let the family kitchen desktop into racing track.
AR Augmented Reality games include:
- The real environment, the object into a game scene
- Virtual game elements (people, vehicles) in the game scenario events, interactive games and objects in the scene
Desktop Racing Scene
Intel real sense camera RealSense R200
Intel's next-generation real sense R200 camera can be used to scan and restore the real environment, the physical frame to the 3D scanning data environment and the surface color data to the game to use.
3D game to get environmental data, we need to rebuild a virtual display data, including network model of the object, re-texture and light computing, virtual worlds and build the physical properties of the collision. Then add the virtual game in which the object, such as vehicles, characters and weapons in the game, and so on. Players can experience the game on a plate for larger screen experience that can send data to the game scene on TV, more comfortable to play on the big TV screen.
According to real-world scenarios to build the game for the game's design, presented additional challenges:
- Unpredictable game scene, how to set goals story of the game?
- Game scene diversification, the physical movement of the game objects can be manipulated higher stability requirements
Epilogue
TV screen as a home entertainment center, game consoles to connect abroad mainly in the domestic smart TV as the main form. 2D and 3D cameras now, the TV screen is useful operation peripherals can be used for voice / gesture control, 3D movement / dance games. In the future, with 3D scanning function camera will provide more playability and a new video game experience.
