logo
Browse Source

update the readme.

Signed-off-by: wxywb <xy.wang@zilliz.com>
main
wxywb 2 years ago
parent
commit
f29283e458
  1. 48
      README.md

48
README.md

@ -21,38 +21,26 @@ Load an image from path './teddy.jpg' to generate an image embedding.
Read the text 'スケートボードに乗っているテディベア。' to generate an text embedding. Read the text 'スケートボードに乗っているテディベア。' to generate an text embedding.
*Write the pipeline in simplified style*:
```python
import towhee
towhee.glob('./teddy.jpg') \
.image_decode() \
.image_text_embedding.japanese_clip(model_name='japanese-clip-vit-b-16', modality='image') \
.show()
towhee.dc(["スケートボードに乗っているテディベア。"]) \
.image_text_embedding.japanese_clip(model_name='japanese-clip-vit-b-16', modality='text') \
.show()
```
<img src="./vec1.png" alt="result1" style="height:20px;"/>
<img src="./vec2.png" alt="result2" style="height:20px;"/>
*Write a same pipeline with explicit inputs/outputs name specifications:* *Write a same pipeline with explicit inputs/outputs name specifications:*
```python ```python
import towhee
towhee.glob['path']('./teddy.jpg') \
.image_decode['path', 'img']() \
.image_text_embedding.japanese_clip['img', 'vec'](model_name='japanese-clip-vit-b-16', modality='image') \
.select['img', 'vec']() \
.show()
towhee.dc['text'](["スケートボードに乗っているテディベア。"]) \
.image_text_embedding.japanese_clip['text','vec'](model_name='japanese-clip-vit-b-16', modality='text') \
.select['text', 'vec']() \
.show()
from towhee.dc2 import pipe, ops, DataCollection
img_pipe = (
pipe.input('url')
.map('url', 'img', ops.image_decode.cv2_rgb())
.map('img', 'vec', ops.image_text_embedding.japanese_clip(model_name='japanese-clip-vit-b-16', modality='image'))
.output('img', 'vec')
)
text_pipe = (
pipe.input('text')
.map('text', 'vec', ops.image_text_embedding.japanese_clip(model_name='japanese-clip-vit-b-16', modality='text'))
.output('text', 'vec')
)
DataCollection(img_pipe('./teddy.jpg')).show()
DataCollection(text_pipe('スケートボードに乗っているテディベア。')).show()
``` ```
<img src="./tabular1.png" alt="result1" style="height:60px;"/> <img src="./tabular1.png" alt="result1" style="height:60px;"/>
<img src="./tabular2.png" alt="result2" style="height:60px;"/> <img src="./tabular2.png" alt="result2" style="height:60px;"/>
@ -72,7 +60,7 @@ Create the operator via the following factory method
***model_name:*** *str* ***model_name:*** *str*
​ The model name of CLIP. Supported model names:
​ The model name of Japanese CLIP. Supported model names:
- japanese-clip-vit-b-16 - japanese-clip-vit-b-16
- japanese-cloob-vit-b-16 - japanese-cloob-vit-b-16

Loading…
Cancel
Save