Techniques for controlling a robotic device in motion using image synthesis are presented. A method includes determining local motion features based on image patches included in first and second input images captured by a camera installed on the robotic device; determining a camera motion based on the local motion features, wherein the camera motion indicates a movement of the camera between capture of the first input image and capture of the second input image; determining a scene geometry based on the camera motion, wherein the scene geometry is a set of three-dimensional coordinates corresponding to two-dimensional image coordinates of the image patches; generating a single perspective synthesized image based on the camera motion and the scene geometry; detecting a change between the first and second input images based on the synthesized image; and modifying motion of the robotic device based on the detected at least one change.

The present disclosure relates to methods and apparatus for graphics processing. The apparatus may configure a plurality of billboards associated with a viewpoint of a first frame of a plurality of frames, the plurality of billboards being configured in one or more layers at least partially around the viewpoint, the configuration of the plurality of billboards being based on one or more volumetric elements between at least one of the plurality of billboards and the viewpoint. The apparatus may also render an image associated with each of the one or more volumetric elements between at least one billboard of the plurality of billboards and the viewpoint, the rendered image including a set of pixels. The apparatus may also store data in the at least one billboard based on the rendered image associated with each of the one or more volumetric elements, the data corresponding to the set of pixels.

Systems and methods for monitoring a dental patient's progress during treatment. A camera coordinate system of a virtual camera is aligned to be coincident with a world coordinate system of a 3D) model representing a expected configuration of the patient's teeth at a particular time during treatment. One or more expected 2D images generated by mapping points from the 3D model to points on an image plane of the virtual camera. One or more 2D images of the patient's teeth taken at the particular time during treatment are compared to the expected 2D images to determine whether a configuration of the patient's teeth is within a threshold level of correspondence to the expected configuration of the patient's teeth. An indication about whether the dental treatment is proceeding as expected based on whether the configuration of the patient's teeth is within the threshold level can be provided.

An image processing device is described herein including an information input unit that receives as an input three-dimensional structure information indicating a three-dimensional structure of a heart; and an image generation unit that develops an inner wall of atria and ventricles of the heart indicated by the three-dimensional structure information into a two-dimensional image based on an equal-area projection and generates a developed image interrupted by dividing the two-dimensional image into a front wall, a rear wall, a left wall, and a right wall. The image generation unit maps the three-dimensional structure in the atria and ventricles of the heart indicated in the three-dimensional structure information on the developed image by a projection of expressing the three-dimensional structure with saturation and lightness.

An image processing device is described herein including an information input unit that receives as an input three-dimensional structure information indicating a three-dimensional structure of a heart; and an image generation unit that develops an inner wall of atria and ventricles of a heart indicated by the three-dimensional structure information into a two-dimensional image based on an equal-area projection, and generates a developed image interrupted by dividing the two-dimensional image into a front wall, a rear wall, a left wall, and a right wall.

An image processing method includes performing horizontal division and vertical division on a longitude-latitude map or a sphere map of a to-be-processed image to obtain sub-areas of the longitude-latitude map or the sphere map, where a division location of the horizontal division is a preset latitude, a division location of the vertical division is determined by a latitude, there are at least two types of vertical division intervals in an area formed by adjacent division locations of the horizontal division, and a vertical division interval is a distance between adjacent division locations of the vertical division, and encoding images of the sub-areas.

An electronic device is provided. The electronic device includes a communication module comprising communication circuitry, a memory configured to store first information indicating first image data generated using a first rendering scheme based on a first polyhedron configured with a first number of surfaces and second information indicating second image data generated using a second rendering scheme based on a second polyhedron configured with a second number of surfaces, and a processor. The processor is configured to verify state information of the electronic device, to select one of the first information and the second information based on the at least state information, to transmit a request corresponding to the selected information to an external electronic device via the communication module, to receive image data corresponding to the selected information between the first image data and the second image data from the external electronic device in response to the request, and to control playback of the received image data.

Techniques and systems to support immersive media content navigation and editing are described. A two-dimensional equirectangular projection of a spherical video is generated by a computing device and displayed in a navigator portion of a user interface of a content editing application. A visual position indicator, indicative of a position within the spherical video, is displayed over the 2D equirectangular projection of the spherical video. A portion of the spherical video is determined based on the position, and a planar spherical view of the portion of the spherical video is generated by the computing device and displayed in a compositor portion of the user interface. The navigator portion and the compositor portion are linked such that user input to the navigator portion or the compositor portion of the user interface causes corresponding visual changes in both the navigator portion and the compositor portion of the user interface.

A projection-based frame is generated according to an omnidirectional video frame and an octahedron projection layout. The projection-based frame has a 360-degree image content represented by triangular projection faces assembled in the octahedron projection layout. A 360-degree image content of a viewing sphere is mapped onto the triangular projection faces via an octahedron projection of the viewing sphere. One side of a first triangular projection face has contact with one side of a second triangular projection face, one side of a third triangular projection face has contact with another side of the second triangular projection face. One image content continuity boundary exists between one side of the first triangular projection face and one side of the second triangular projection face, and another image content continuity boundary exists between one side of the third triangular projection face and another side of the second triangular projection face.

The present invention discloses a method for guiding and releasing energy based on a three-dimensional skin temperature topographic map, and also relates to a corresponding device for guiding and releasing energy. The device for guiding and releasing energy performs dynamic closed-loop control on a temperature sensor and an interventional energy release unit, and eventually controls a temperature value of skin tissue to be within an optimal temperature range to achieve dynamic balance between interventional energy therapy and dynamic monitoring and diagnosis. The three-dimensional skin temperature topographic map is displayed according to spatial location data and real-time temperature data, so that an operator is provided with intuitive and clear operation instructions.