Patent classifications
G06F7/14
Merge small file consolidation
The subject technology receives a query plan corresponding to a query. The subject technology executes the query based at least in part on the query plan, the executing including: filtering a first set of files that are to be modified by a merge statement, performing a split operation to send information related to a second set of files to a scan set builder operation in a first portion of the query plan and scan back operation in a second portion of the query plan, performing the scan set builder operation to remove the second set of files from the first set of files, performing a table scan operation based on a third set of files, and performing a first union all operation to combine the first set of data with a second set of data as a first set of combined data.
Merge small file consolidation
The subject technology receives a query plan corresponding to a query. The subject technology executes the query based at least in part on the query plan, the executing including: filtering a first set of files that are to be modified by a merge statement, performing a split operation to send information related to a second set of files to a scan set builder operation in a first portion of the query plan and scan back operation in a second portion of the query plan, performing the scan set builder operation to remove the second set of files from the first set of files, performing a table scan operation based on a third set of files, and performing a first union all operation to combine the first set of data with a second set of data as a first set of combined data.
METHOD AND DEVICE FOR MANAGING PROJECT BY USING DATA MERGING
Disclosed are a method and device for managing a project by using data merging. A project is efficiently operated by dividing a project based on a minimum unit task and designing a plurality of child projects connected in sequential order such that a plurality of child projects proceed in order.
METHOD AND DEVICE FOR MANAGING PROJECT BY USING DATA MERGING
Disclosed are a method and device for managing a project by using data merging. A project is efficiently operated by dividing a project based on a minimum unit task and designing a plurality of child projects connected in sequential order such that a plurality of child projects proceed in order.
HIGH FREQUENCY SNAPSHOT TECHNIQUE FOR IMPROVING DATA REPLICATION IN DISASTER RECOVERY ENVIRONMENT
A high frequency snapshot technique improves data replication in a disaster recovery (DR) environment. A base snapshot is generated from failover data at a primary site and replicated to a placeholder file at a secondary site. Upon commencement of the base snapshot generation and replication, incremental light weight snapshots (LWSs) of the failover data are captured and replicated to the secondary site. A staging file at the secondary site accumulates the replicated LWSs (“high-frequency snapshots”). The staging file is populated with the LWSs in parallel with the replication of the base snapshot at the placeholder file. At a subsequent predetermined time interval, the accumulated LWSs are synthesized to capture a “checkpoint” snapshot by applying and pruning the accumulated LWSs at the staging file. Once the base snapshot is fully replicated, the pruned LWSs are merged to the base snapshot to synchronize the replicated failover data.
HIGH FREQUENCY SNAPSHOT TECHNIQUE FOR IMPROVING DATA REPLICATION IN DISASTER RECOVERY ENVIRONMENT
A high frequency snapshot technique improves data replication in a disaster recovery (DR) environment. A base snapshot is generated from failover data at a primary site and replicated to a placeholder file at a secondary site. Upon commencement of the base snapshot generation and replication, incremental light weight snapshots (LWSs) of the failover data are captured and replicated to the secondary site. A staging file at the secondary site accumulates the replicated LWSs (“high-frequency snapshots”). The staging file is populated with the LWSs in parallel with the replication of the base snapshot at the placeholder file. At a subsequent predetermined time interval, the accumulated LWSs are synthesized to capture a “checkpoint” snapshot by applying and pruning the accumulated LWSs at the staging file. Once the base snapshot is fully replicated, the pruned LWSs are merged to the base snapshot to synchronize the replicated failover data.
DATA MERGING METHOD AND APPARATUS OF PHYSICAL RANDOM ACCESS CHANNEL, AND STORAGE MEDIUM
Provided are a data merging method and apparatus for physical random access channel (PRACH) data merging, and a storage medium. The method includes the following. A task parameter of Current PRACH data merging is parsed. PRACH data of a to-be-merged antenna is read from a PRACH data cache. PRACH data merging between multiple antennas and/or RACH data merging within a PRACH of a present antenna are performed according to the task parameter. Merged data is output to a shared cache.
DATA MERGING METHOD AND APPARATUS OF PHYSICAL RANDOM ACCESS CHANNEL, AND STORAGE MEDIUM
Provided are a data merging method and apparatus for physical random access channel (PRACH) data merging, and a storage medium. The method includes the following. A task parameter of Current PRACH data merging is parsed. PRACH data of a to-be-merged antenna is read from a PRACH data cache. PRACH data merging between multiple antennas and/or RACH data merging within a PRACH of a present antenna are performed according to the task parameter. Merged data is output to a shared cache.
Method for training neural network model and apparatus
This application provides a method for training a neural network model and an apparatus. The method includes: obtaining annotation data that is of a service and that is generated by a terminal device in a specified period; training a second neural network model by using the annotation data that is of the service and that is generated in the specified period, to obtain a trained second neural network model; and updating a first neural network model based on the trained second neural network model. In the method, training is performed based on the annotation data generated by the terminal device, so that in an updated first neural network model compared with a universal model, an inference result has a higher confidence level, and a personalized requirement of a user can be better met.
Data acquisition system, input device, data acquisition apparatus, and data combining apparatus
A data acquisition system according to an embodiment includes an input device, a data acquisition apparatus, and a data combining apparatus. The input device includes a data measurer configured to acquire measurement data by performing measurement, generate sequence information representing a sequence of the acquired measurement data, and transmit the measurement data and the sequence information to the data acquisition apparatus. The data acquisition apparatus includes a data collector configured to, when receiving the measurement data and the sequence information, generate time information, and when failing to receive the measurement data and the sequence information, generate data loss information. The data combining apparatus includes a data combiner configured to acquire data from the input device and the data acquisition apparatus, collate the sequence information therein, and replace the data loss information with the measurement data in the data obtained from the input device, thereby generating combined data.