Methods, systems, and apparatus, including computer programs encoded on computer storage media for evaluating and improving live translation captioning systems. An exemplary method includes: displaying a word in a first language; receiving a first audio sequence, the first audio sequence comprising a verbal description of the word; generating a first translated text in a second language; displaying the first translated text; receiving a second audio sequence, the second audio sequence comprising a guessed word based on the first translated text; generating a second translated text in the first language; determining a matching score between the word and the second translated text; determining a performance score of the live translation captioning system based on the matching score.

Systems, methods, devices, and non-transitory, computer-readable storage media are disclosed for matching a service requester with a service provider via a taxonomy based directed graph. The method includes: receiving a keyword associated with a service; accessing a directed graph including a root node and nodes connected by edges, each node having a title; identifying a second node of the directed graph for each of service providers, each second node having a title matching a skill of a respective service provider; determining a distance between the first node and each second node along the directed graph; and ranking the service providers based at least in part on the distance between the first node and each second node. Systems, methods, devices, and non-transitory, computer-readable storage media are further disclosed for determining and storing a quality score for the revised linguistic content.

Systems, methods, devices, and non-transitory, computer-readable storage media are disclosed for matching a service requester with a service provider via a taxonomy based directed graph. The method includes: receiving a keyword associated with a service; accessing a directed graph including a root node and nodes connected by edges, each node having a title; identifying a second node of the directed graph for each of service providers, each second node having a title matching a skill of a respective service provider; determining a distance between the first node and each second node along the directed graph; and ranking the service providers based at least in part on the distance between the first node and each second node. Systems, methods, devices, and non-transitory, computer-readable storage media are further disclosed for determining and storing a quality score for the revised linguistic content.

Embodiments of the present disclosure relate to a method and apparatus for evaluating a translation quality. The method may include: acquiring a to-be-evaluated translation and a reference translation; inputting the to-be-evaluated translation and the reference translation into a pre-trained repetition coding model to obtain a semantic similarity between the to-be-evaluated translation and the reference translation, the repetition coding model being a neural network for calculating a probability of a pair of sentences being repetition sentences; analyzing the to-be-evaluated translation and the reference translation into two syntax trees respectively; calculating a similarity between the two syntax trees as a text similarity between the to-be-evaluated translation and the reference translation; and using a weighted sum of the semantic similarity and the text similarity as a translation quality score.

Embodiments of the present disclosure relate to a method and apparatus for evaluating a translation quality. The method may include: acquiring a to-be-evaluated translation and a reference translation; inputting the to-be-evaluated translation and the reference translation into a pre-trained repetition coding model to obtain a semantic similarity between the to-be-evaluated translation and the reference translation, the repetition coding model being a neural network for calculating a probability of a pair of sentences being repetition sentences; analyzing the to-be-evaluated translation and the reference translation into two syntax trees respectively; calculating a similarity between the two syntax trees as a text similarity between the to-be-evaluated translation and the reference translation; and using a weighted sum of the semantic similarity and the text similarity as a translation quality score.

A method for sequence-to-sequence prediction using a neural network model includes A method for sequence-to-sequence prediction using a neural network model, generating an encoded representation based on an input sequence using an encoder of the neural network model, predicting a fertility sequence based on the input sequence, generating an output template based on the input sequence and the fertility sequence, and predicting an output sequence based on the encoded representation and the output template using a decoder of the neural network model. The neural network model includes a plurality of model parameters learned according to a machine learning process. Each item of the fertility sequence includes a fertility count associated with a corresponding item of the input sequence.

A method for sequence-to-sequence prediction using a neural network model includes A method for sequence-to-sequence prediction using a neural network model, generating an encoded representation based on an input sequence using an encoder of the neural network model, predicting a fertility sequence based on the input sequence, generating an output template based on the input sequence and the fertility sequence, and predicting an output sequence based on the encoded representation and the output template using a decoder of the neural network model. The neural network model includes a plurality of model parameters learned according to a machine learning process. Each item of the fertility sequence includes a fertility count associated with a corresponding item of the input sequence.

A training method, a text translation method, an electronic device, and a storage medium, which relate to a field of artificial intelligence, in particular to fields of natural language processing and deep learning technologies. A specific implementation solution includes: performing a feature extraction on source sample text data to obtain a sample feature vector sequence; obtaining a target sample feature vector according to the sample feature vector sequence; performing an autoregressive decoding and a non-autoregressive decoding on the sample feature vector sequence, respectively; performing a length prediction on the target sample feature vector; training a predetermined model by using translation sample data, the autoregressive text translation result, the non-autoregressive text translation result, a true length value of the source sample text, the first predicted length value, a true length value of the translation sample text, and the second predicted length value to obtain the text translation model.

A training method, a text translation method, an electronic device, and a storage medium, which relate to a field of artificial intelligence, in particular to fields of natural language processing and deep learning technologies. A specific implementation solution includes: performing a feature extraction on source sample text data to obtain a sample feature vector sequence; obtaining a target sample feature vector according to the sample feature vector sequence; performing an autoregressive decoding and a non-autoregressive decoding on the sample feature vector sequence, respectively; performing a length prediction on the target sample feature vector; training a predetermined model by using translation sample data, the autoregressive text translation result, the non-autoregressive text translation result, a true length value of the source sample text, the first predicted length value, a true length value of the translation sample text, and the second predicted length value to obtain the text translation model.

A source content routing system is described for distributing source content received from clients such as documents, to translators for performing translation services on the source content. The routing system extracts source content features, which may be represented as vectors. The vectors may be assembled into an input matrix, which may be processed using an artificial neural network, classifier, perceptron, CRF model, and/or the like, to select a translator such as a machine translation system and/or human. The translator provides translation services translation from a source language to a target language, post translation editing, proof reading, quality analysis of a machine, quality analysis of human translation, and/or the like and returns the product to the content routing system or clients.