Aspects of the present disclosure relate to grounded multimodal agent interactions, where a natural language user input is processed using a multimodal machine learning model to generate model output. The model output may then be processed to affect the behavior of an application, for example to enable a user to control the application and/or to facilitate user interactions with a conversational agent, among other examples. In some instances, at least a part of the model output may be executed or parsed, for example to generate three dimensional objects within a coding application. Thus, use of a multimodal machine learning model according to aspects described herein may enable the use of user-provided natural language input to affect the behavior of an application accordingly.

A cloud system includes: an individual peripheral device including a microcontroller and a memory electrically connected to the microcontroller, wherein the microcontroller collects input-output data of the individual peripheral device, and the memory stores product data, user data of the individual peripheral device and the input-output data; a local host device electrically connected to the individual peripheral device, configured to receive the product data, the user data and the input-output data, wherein the local host device collects environment data of the individual peripheral device; and a cloud unit communicatively connected to the local host device, configured to receive the product data, the user data, the input-output data and the environment data and status data of the local host device, and output an effective parameter according to the input-output data, the environment data and the status data, wherein the effective parameter is for correcting the input-output data.

A game controller has first and second controllers detachably coupled to a bridge or an information handling system housing to provide inputs to a gaming application executing on the information handling system, such as from a joystick input device integrated in each controller. Logic stored in non-transitory memory of the information handling system executes to track game controllers based upon unique identifiers retrieved from each controller to the information handling system, such as through a direct coupling of the controllers to the information handling system or indirect communication by the information handling system with a bridge directly coupled to the controllers. The information handling system sets priority for inputs from game controllers based upon controller unique identifiers and also tracks composite game controller assemblies that include controllers and a bridge.

A controller device comprises a controller body that includes one or more interface ports, at least which is a control information output port. A joystick coupled to the controller body has an axis control orientation that is configurable relative to the controller body.

A controller device comprises a controller body that includes one or more interface ports, at least which is a control information output port. A joystick coupled to the controller body has an axis control orientation that is configurable relative to the controller body.

A system that incorporates teachings of the present disclosure may include, for example, an accessory having a plurality of tactile-sensitive buttons, a plurality of light sources, wherein each light source emits a controllable spectrum of light through a corresponding one of the plurality of tactile-sensitive buttons, and a controller coupled to the plurality of tactile-sensitive buttons, and the plurality of light sources. The controller can be operable to detect tactile contact of each of the plurality of tactile-sensitive buttons, receive status information associated with a video game, and adjust the spectrum of light emitted by at least a portion of the plurality of light sources according to the status information to indicate one or more aspects of the video game. Additional embodiments are disclosed.

An information processing apparatus includes a captured image acquisition unit that acquires an image captured by imaging a device including plural markers. A marker image coordinate specification unit specifies a representative coordinate of each marker image from the captured image, and a position and posture derivation unit derives position information and posture information of the device using the representative coordinates of the marker images. The marker image coordinate specification unit specifies a first boundary box surrounding a region within which pixels having a first luminance or more continuously appear, specifies a second boundary box surrounding a region within which pixels having a second luminance or more continuously appear in the first boundary box, the second luminance being higher than the first luminance, and derives a representative coordinate of each marker image based on pixels in the first or second boundary box in response to the number of specified second boundary boxes.

A projected target location of a handheld object is determined based on applying translation factors, scaling factors, and offsets to a location of a reference element of the handheld object detected by a camera on a two-dimensional plane. The translation factors are determined based on a difference between a calibration location on the plane and an initial location of the reference element corresponding to the calibration location, and serve to shift the location of the reference element to generate the projected target location. The scaling factors are determined based on an estimated length of a user's arm holding the handheld object, and serve to scale the location of the reference element to generate the projected target location. The offsets are determined based on polynomial equations, and serve to extend the distance between the projected target location and the calibration location.

A technique for implementing computerized games includes providing multiple gameplay spaces of a computerized game and receiving a model of a physical environment in which the game is to be played. The technique proceeds by fitting the gameplay spaces of the game to the model, such as by placing the gameplay spaces and their respective virtual objects into respective portions of the model, thus actualizing the game to the particular environment in which the game is to be played.

A technique for implementing computerized games includes providing multiple gameplay spaces of a computerized game and receiving a model of a physical environment in which the game is to be played. The technique proceeds by fitting the gameplay spaces of the game to the model, such as by placing the gameplay spaces and their respective virtual objects into respective portions of the model, thus actualizing the game to the particular environment in which the game is to be played.