logo
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Readme
Files and versions

73 lines
1.1 KiB

3 years ago
# Text Embedding with data2vec
*author: David Wang*
<br />
## Description
This operator extracts features for text with [data2vec](https://arxiv.org/abs/2202.03555). The core idea is to predict latent representations of the full input data based on a masked view of the input in a self-distillation setup using a standard Transformer architecture.
<br />
## Code Example
Use the pre-trained model to generate a text embedding for the sentence "Hello, world.".
*Write the pipeline in simplified style*:
```python
import towhee
towhee.dc(["Hello, world."]) \
.text_embedding.data2vec() \
.show()
```
<br />
## Factory Constructor
Create the operator via the following factory method
***data2vec(model_name='facebook/data2vec-text-base')***
**Parameters:**
***model_name***: *str*
The model name in string.
The default value is "facebook/data2vec-text-base".
Supported model name:
- facebook/data2vec-text-base
<br />
## Interface
**Parameters:**
***text:*** *str*
​ The text in string.
**Returns:** *numpy.ndarray*
​ The text embedding extracted by model.
3 years ago