AI Gallery 资产详情

您的余额不足，模型已暂停发布查看详情

1. ChatGLM3简介

ChatGLM3-6B 是一个基于 Transformer 的预训练语言模型，由清华大学 KEG 实验室和智谱 AI 公司于 2023 年共同训练发布。该模型的基本原理是将大量无标签文本数据进行预训练，然后将其用于各种下游任务，例如文本分类、命名实体识别、情感分析等。

ChatGLM3-6B 的核心功能是语言建模，即通过预测下一个单词或字符来建立一个语言模型。该模型采用了 Transformer 结构，这是一种基于自注意力机制的深度神经网络结构，能够有效地捕捉文本中的长期依赖关系。

ChatGLM3-6B 模型具有多种预训练任务，例如文本分类、命名实体识别、情感分析等。在预训练过程中，模型会学习到各种语言知识和模式，从而能够更好地完成各种下游任务。

ChatGLM3-6B 模型的局限性在于它只能处理已经训练好的模型，无法直接用于新的、未标注的数据。此外，由于预训练模型是基于无标签数据的，因此它可能无法完全捕捉到某些特定的语言知识和模式。

总的来说，ChatGLM3-6B 是一个功能强大的语言模型，能够在各种文本相关的任务中表现出色。它的核心功能是基于 Transformer 结构的自注意力机制，能够捕捉文本中的长期依赖关系。同时，它还具有多种预训练任务，能够更好地完成各种下游任务。然而，它的局限性在于只能处理已经训练好的模型，无法直接用于新的、未标注的数据。。

2. 案例体验

🔹 本案例需使用 P100 及以上规格运行，请确保运行规格一致，可按照下图切换规格。

🔹 点击Run in ModelArts，将会进入到ModelArts CodeLab中，这时需要你登录华为云账号，如果没有账号，则需要注册一个，且要进行实名认证，参考《ModelArts准备工作_简易版》即可完成账号注册和实名认证。登录之后，等待片刻，即可进入到CodeLab的运行环境

🔹 出现 Out Of Memory ，请检查是否为您的参数配置过高导致，修改参数配置，重启kernel或更换更高规格资源进行规避❗❗❗

2.1 下载ChatGLM3模型

import os
import moxing as mox

#拷贝chatglm3模型到chatglm3-6b目录下
work_dir = '/home/ma-user/work'
obs_path = 'obs://dtse-models/tar-models/chatglm3-6b.tar'
ma_path = os.path.join(work_dir, 'chatglm3-6b.tar')
mox.file.copy(obs_path, ma_path)

mox.file.copy_parallel('obs://modelarts-labs-bj4-v2/course/ModelBox/frpc_linux_amd64', '/home/ma-user/work/frpc_linux_amd64')

解压chatglm3模型压缩包

os.chdir(work_dir)
!pwd
!tar -xvf chatglm3-6b.tar

显示 output

/home/ma-user/work

chatglm3-6b/

chatglm3-6b/.gitattributes

chatglm3-6b/MODEL_LICENSE

chatglm3-6b/README.md

chatglm3-6b/config.json

chatglm3-6b/configuration_chatglm.py

chatglm3-6b/modeling_chatglm.py

chatglm3-6b/pytorch_model-00001-of-00007.bin

chatglm3-6b/pytorch_model-00002-of-00007.bin

chatglm3-6b/pytorch_model-00003-of-00007.bin

chatglm3-6b/pytorch_model-00004-of-00007.bin

chatglm3-6b/pytorch_model-00005-of-00007.bin

chatglm3-6b/pytorch_model-00006-of-00007.bin

chatglm3-6b/pytorch_model-00007-of-00007.bin

chatglm3-6b/pytorch_model.bin.index.json

chatglm3-6b/quantization.py

chatglm3-6b/tokenization_chatglm.py

chatglm3-6b/tokenizer.model

chatglm3-6b/tokenizer_config.json

2.2 配置环境

本案例依赖Python3.10.10及以上环境，因此我们首先创建虚拟环境：

!/home/ma-user/anaconda3/bin/conda create -n python-3.10.10 python=3.10.10 -y --override-channels --channel https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
!/home/ma-user/anaconda3/envs/python-3.10.10/bin/pip install ipykernel

显示 output

/home/ma-user/anaconda3/lib/python3.7/site-packages/requests/__init__.py:91: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!
  RequestsDependencyWarning)
Collecting package metadata (current_repodata.json): done
Solving environment: failed with repodata from current_repodata.json, will retry with next repodata source.
Collecting package metadata (repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: /home/ma-user/anaconda3/envs/python-3.10.10

  added / updated specs:
    - python=3.10.10


The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    _libgcc_mutex-0.1          |             main           3 KB  https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
    _openmp_mutex-5.1          |            1_gnu          21 KB  https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
    bzip2-1.0.8                |       h7b6447c_0          78 KB  https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
    ca-certificates-2023.08.22 |       h06a4308_0         123 KB  https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
    ld_impl_linux-64-2.38      |       h1181459_1         654 KB  https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
    libffi-3.4.4               |       h6a678d5_0         142 KB  https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
    libgcc-ng-11.2.0           |       h1234567_1         5.3 MB  https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
    libgomp-11.2.0             |       h1234567_1         474 KB  https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
    libstdcxx-ng-11.2.0        |       h1234567_1         4.7 MB  https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
    libuuid-1.41.5             |       h5eee18b_0          27 KB  https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
    ncurses-6.4                |       h6a678d5_0         914 KB  https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
    openssl-1.1.1w             |       h7f8727e_0         3.7 MB  https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
    pip-23.3.1                 |  py310h06a4308_0         2.7 MB  https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
    python-3.10.10             |       h7a1cb2a_2        26.9 MB  https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
    readline-8.2               |       h5eee18b_0         357 KB  https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
    setuptools-68.0.0          |  py310h06a4308_0         936 KB  https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
    sqlite-3.41.2              |       h5eee18b_0         1.2 MB  https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
    tk-8.6.12                  |       h1ccaba5_0         3.0 MB  https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
    tzdata-2023c               |       h04d1e81_0         116 KB  https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
    wheel-0.41.2               |  py310h06a4308_0         109 KB  https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
    xz-5.4.5                   |       h5eee18b_0         646 KB  https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
    zlib-1.2.13                |       h5eee18b_0         103 KB  https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
    ------------------------------------------------------------
                                           Total:        52.1 MB

The following NEW packages will be INSTALLED:

  _libgcc_mutex      anaconda/pkgs/main/linux-64::_libgcc_mutex-0.1-main
  _openmp_mutex      anaconda/pkgs/main/linux-64::_openmp_mutex-5.1-1_gnu
  bzip2              anaconda/pkgs/main/linux-64::bzip2-1.0.8-h7b6447c_0
  ca-certificates    anaconda/pkgs/main/linux-64::ca-certificates-2023.08.22-h06a4308_0
  ld_impl_linux-64   anaconda/pkgs/main/linux-64::ld_impl_linux-64-2.38-h1181459_1
  libffi             anaconda/pkgs/main/linux-64::libffi-3.4.4-h6a678d5_0
  libgcc-ng          anaconda/pkgs/main/linux-64::libgcc-ng-11.2.0-h1234567_1
  libgomp            anaconda/pkgs/main/linux-64::libgomp-11.2.0-h1234567_1
  libstdcxx-ng       anaconda/pkgs/main/linux-64::libstdcxx-ng-11.2.0-h1234567_1
  libuuid            anaconda/pkgs/main/linux-64::libuuid-1.41.5-h5eee18b_0
  ncurses            anaconda/pkgs/main/linux-64::ncurses-6.4-h6a678d5_0
  openssl            anaconda/pkgs/main/linux-64::openssl-1.1.1w-h7f8727e_0
  pip                anaconda/pkgs/main/linux-64::pip-23.3.1-py310h06a4308_0
  python             anaconda/pkgs/main/linux-64::python-3.10.10-h7a1cb2a_2
  readline           anaconda/pkgs/main/linux-64::readline-8.2-h5eee18b_0
  setuptools         anaconda/pkgs/main/linux-64::setuptools-68.0.0-py310h06a4308_0
  sqlite             anaconda/pkgs/main/linux-64::sqlite-3.41.2-h5eee18b_0
  tk                 anaconda/pkgs/main/linux-64::tk-8.6.12-h1ccaba5_0
  tzdata             anaconda/pkgs/main/noarch::tzdata-2023c-h04d1e81_0
  wheel              anaconda/pkgs/main/linux-64::wheel-0.41.2-py310h06a4308_0
  xz                 anaconda/pkgs/main/linux-64::xz-5.4.5-h5eee18b_0
  zlib               anaconda/pkgs/main/linux-64::zlib-1.2.13-h5eee18b_0



Downloading and Extracting Packages
libffi-3.4.4         | 142 KB    | ##################################### | 100% 
ncurses-6.4          | 914 KB    | ##################################### | 100% 
wheel-0.41.2         | 109 KB    | ##################################### | 100% 
libuuid-1.41.5       | 27 KB     | ##################################### | 100% 
libgcc-ng-11.2.0     | 5.3 MB    | ##################################### | 100% 
ca-certificates-2023 | 123 KB    | ##################################### | 100% 
bzip2-1.0.8          | 78 KB     | ##################################### | 100% 
ld_impl_linux-64-2.3 | 654 KB    | ##################################### | 100% 
readline-8.2         | 357 KB    | ##################################### | 100% 
openssl-1.1.1w       | 3.7 MB    | ##################################### | 100% 
libgomp-11.2.0       | 474 KB    | ##################################### | 100% 
tzdata-2023c         | 116 KB    | ##################################### | 100% 
python-3.10.10       | 26.9 MB   | ##################################### | 100% 
setuptools-68.0.0    | 936 KB    | ##################################### | 100% 
_openmp_mutex-5.1    | 21 KB     | ##################################### | 100% 
xz-5.4.5             | 646 KB    | ##################################### | 100% 
tk-8.6.12            | 3.0 MB    | ##################################### | 100% 
libstdcxx-ng-11.2.0  | 4.7 MB    | ##################################### | 100% 
pip-23.3.1           | 2.7 MB    | ##################################### | 100% 
_libgcc_mutex-0.1    | 3 KB      | ##################################### | 100% 
zlib-1.2.13          | 103 KB    | ##################################### | 100% 
sqlite-3.41.2        | 1.2 MB    | ##################################### | 100% 
Preparing transaction: done
Verifying transaction: done
Executing transaction: done
#
# To activate this environment, use
#
#     $ conda activate python-3.10.10
#
# To deactivate an active environment, use
#
#     $ conda deactivate

Looking in indexes: http://repo.myhuaweicloud.com/repository/pypi/simple
Collecting ipykernel
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/5d/4b/ffb537e392e730c9a5b02758f9c87077d9087bcb0d957853e13f121e5ea7/ipykernel-6.23.1-py3-none-any.whl (152 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 152.2/152.2 kB 13.2 MB/s eta 0:00:00
Collecting comm>=0.1.1 (from ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/74/f3/b88d7e1dadf741550c56b70d7ce62673354fddb68e143d193ceb80224208/comm-0.1.3-py3-none-any.whl (6.6 kB)
Collecting debugpy>=1.6.5 (from ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/1f/19/345c21f6b62acf556c39e4358a22b0ad868fecb462c1041c13513d229b33/debugpy-1.6.6-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.0/3.0 MB 30.7 MB/s eta 0:00:00a 0:00:01
Collecting ipython>=7.23.1 (from ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/09/db/d641ee07f319002393524b6c5a8b47370520dcb2b6166a0972cfe9398c60/ipython-8.10.0-py3-none-any.whl (784 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 784.3/784.3 kB 48.7 MB/s eta 0:00:00
Collecting jupyter-client>=6.1.12 (from ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/07/37/4019d2c41ca333c08dfdfeb84c0fc0368c8defbbd3c8f0c9a530851e5813/jupyter_client-8.2.0-py3-none-any.whl (103 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 103.2/103.2 kB 9.6 MB/s eta 0:00:00
Collecting jupyter-core!=5.0.*,>=4.12 (from ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/41/1e/92a67f333b9335f04ce409799c030dcfb291712658b9d9d13997f7c91e5a/jupyter_core-5.3.0-py3-none-any.whl (93 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 93.2/93.2 kB 13.1 MB/s eta 0:00:00
Collecting matplotlib-inline>=0.1 (from ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/a6/2d/2230afd570c70074e80fd06857ba2bdc5f10c055bd9125665fe276fadb67/matplotlib_inline-0.1.3-py3-none-any.whl (8.2 kB)
Collecting nest-asyncio (from ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/06/e0/93453ebab12f5ce9a9ceda2ff71648b30e5f2ce5bba19ee3c95cbd0aaa67/nest_asyncio-1.5.4-py3-none-any.whl (5.1 kB)
Collecting packaging (from ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/ec/1a/610693ac4ee14fcdf2d9bf3c493370e4f2ef7ae2e19217d7a237ff42367d/packaging-23.2-py3-none-any.whl (53 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 53.0/53.0 kB 6.5 MB/s eta 0:00:00
Collecting psutil (from ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/6e/c8/784968329c1c67c28cce91991ef9af8a8913aa5a3399a6a8954b1380572f/psutil-5.9.4-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (280 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 280.2/280.2 kB 13.7 MB/s eta 0:00:00
Collecting pyzmq>=20 (from ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/79/f4/c33ff6e3d7bfbceecbb2176f75328c897365a519f507d226e44eea74d6d2/pyzmq-25.1.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 57.7 MB/s eta 0:00:00
Collecting tornado>=6.1 (from ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/66/a5/e6da56c03ff61200d5a43cfb75ab09316fc0836aa7ee26b4e9dcbfc3ae85/tornado-6.3.3-cp38-abi3-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (427 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 427.7/427.7 kB 14.1 MB/s eta 0:00:00a 0:00:01
Collecting traitlets>=5.4.0 (from ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/77/75/c28e9ef7abec2b7e9ff35aea3e0be6c1aceaf7873c26c95ae1f0d594de71/traitlets-5.9.0-py3-none-any.whl (117 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 117.4/117.4 kB 12.3 MB/s eta 0:00:00
Collecting backcall (from ipython>=7.23.1->ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/4c/1c/ff6546b6c12603d8dd1070aa3c3d273ad4c07f5771689a7b69a550e8c951/backcall-0.2.0-py2.py3-none-any.whl (11 kB)
Collecting decorator (from ipython>=7.23.1->ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/d5/50/83c593b07763e1161326b3b8c6686f0f4b0f24d5526546bee538c89837d6/decorator-5.1.1-py3-none-any.whl (9.1 kB)
Collecting jedi>=0.16 (from ipython>=7.23.1->ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/6d/60/4acda63286ef6023515eb914543ba36496b8929cb7af49ecce63afde09c6/jedi-0.18.2-py2.py3-none-any.whl (1.6 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 63.4 MB/s eta 0:00:00
Collecting pickleshare (from ipython>=7.23.1->ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/9a/41/220f49aaea88bc6fa6cba8d05ecf24676326156c23b991e80b3f2fc24c77/pickleshare-0.7.5-py2.py3-none-any.whl (6.9 kB)
Collecting prompt-toolkit<3.1.0,>=3.0.30 (from ipython>=7.23.1->ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/87/3f/1f5a0ff475ae6481f4b0d45d4d911824d3218b94ee2a97a8cb84e5569836/prompt_toolkit-3.0.38-py3-none-any.whl (385 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 385.8/385.8 kB 17.5 MB/s eta 0:00:00
Collecting pygments>=2.4.0 (from ipython>=7.23.1->ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/0b/42/d9d95cc461f098f204cd20c85642ae40fbff81f74c300341b8d0e0df14e0/Pygments-2.14.0-py3-none-any.whl (1.1 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 55.4 MB/s eta 0:00:00
Collecting stack-data (from ipython>=7.23.1->ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/6a/81/aa96c25c27f78cdc444fec27d80f4c05194c591465e491a1358d8a035bc1/stack_data-0.6.2-py3-none-any.whl (24 kB)
Collecting pexpect>4.3 (from ipython>=7.23.1->ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/39/7b/88dbb785881c28a102619d46423cb853b46dbccc70d3ac362d99773a78ce/pexpect-4.8.0-py2.py3-none-any.whl (59 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 59.0/59.0 kB 7.6 MB/s eta 0:00:00
Collecting python-dateutil>=2.8.2 (from jupyter-client>=6.1.12->ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/36/7a/87837f39d0296e723bb9b62bbb257d0355c7f6128853c78955f57342a56d/python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 247.7/247.7 kB 13.1 MB/s eta 0:00:00
Collecting platformdirs>=2.5 (from jupyter-core!=5.0.*,>=4.12->ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/ba/24/a83a900a90105f8ad3f20df5bb5a2cde886df7125c7827e196e4ed4fa8a7/platformdirs-3.0.0-py3-none-any.whl (14 kB)
Collecting parso<0.9.0,>=0.8.0 (from jedi>=0.16->ipython>=7.23.1->ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/05/63/8011bd08a4111858f79d2b09aad86638490d62fbf881c44e434a6dfca87b/parso-0.8.3-py2.py3-none-any.whl (100 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 100.8/100.8 kB 13.4 MB/s eta 0:00:00
Collecting ptyprocess>=0.5 (from pexpect>4.3->ipython>=7.23.1->ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/22/a6/858897256d0deac81a172289110f31629fc4cee19b6f01283303e18c8db3/ptyprocess-0.7.0-py2.py3-none-any.whl (13 kB)
Collecting wcwidth (from prompt-toolkit<3.1.0,>=3.0.30->ipython>=7.23.1->ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/59/7c/e39aca596badaf1b78e8f547c807b04dae603a433d3e7a7e04d67f2ef3e5/wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting six>=1.5 (from python-dateutil>=2.8.2->jupyter-client>=6.1.12->ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/d9/5a/e7c31adbe875f2abbb91bd84cf2dc52d792b5a01506781dbcf25c91daf11/six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting executing>=1.2.0 (from stack-data->ipython>=7.23.1->ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/28/3c/bc3819dd8b1a1588c9215a87271b6178cc5498acaa83885211f5d4d9e693/executing-1.2.0-py2.py3-none-any.whl (24 kB)
Collecting asttokens>=2.1.0 (from stack-data->ipython>=7.23.1->ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/f3/e1/64679d9d0759db5b182222c81ff322c2fe2c31e156a59afd6e9208c960e5/asttokens-2.2.1-py2.py3-none-any.whl (26 kB)
Collecting pure-eval (from stack-data->ipython>=7.23.1->ipykernel)
  Downloading http://repo.myhuaweicloud.com/repository/pypi/packages/2b/27/77f9d5684e6bce929f5cfe18d6cfbe5133013c06cb2fbf5933670e60761d/pure_eval-0.2.2-py3-none-any.whl (11 kB)
Installing collected packages: wcwidth, pure-eval, ptyprocess, pickleshare, executing, backcall, traitlets, tornado, six, pyzmq, pygments, psutil, prompt-toolkit, platformdirs, pexpect, parso, packaging, nest-asyncio, decorator, debugpy, python-dateutil, matplotlib-inline, jupyter-core, jedi, comm, asttokens, stack-data, jupyter-client, ipython, ipykernel
Successfully installed asttokens-2.2.1 backcall-0.2.0 comm-0.1.3 debugpy-1.6.6 decorator-5.1.1 executing-1.2.0 ipykernel-6.23.1 ipython-8.10.0 jedi-0.18.2 jupyter-client-8.2.0 jupyter-core-5.3.0 matplotlib-inline-0.1.3 nest-asyncio-1.5.4 packaging-23.2 parso-0.8.3 pexpect-4.8.0 pickleshare-0.7.5 platformdirs-3.0.0 prompt-toolkit-3.0.38 psutil-5.9.4 ptyprocess-0.7.0 pure-eval-0.2.2 pygments-2.14.0 python-dateutil-2.8.2 pyzmq-25.1.1 six-1.16.0 stack-data-0.6.2 tornado-6.3.3 traitlets-5.9.0 wcwidth-0.2.5

import json
import os

data = {
   "display_name": "python-3.10.10",
   "env": {
      "PATH": "/home/ma-user/anaconda3/envs/python-3.10.10/bin:/home/ma-user/anaconda3/envs/python-3.7.10/bin:/modelarts/authoring/notebook-conda/bin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/home/ma-user/modelarts/ma-cli/bin:/home/ma-user/modelarts/ma-cli/bin:/home/ma-user/anaconda3/envs/PyTorch-1.8/bin"
   },
   "language": "python",
   "argv": [
      "/home/ma-user/anaconda3/envs/python-3.10.10/bin/python",
      "-m",
      "ipykernel",
      "-f",
      "{connection_file}"
   ]
}

if not os.path.exists("/home/ma-user/anaconda3/share/jupyter/kernels/python-3.10.10/"):
    os.mkdir("/home/ma-user/anaconda3/share/jupyter/kernels/python-3.10.10/")

with open('/home/ma-user/anaconda3/share/jupyter/kernels/python-3.10.10/kernel.json', 'w') as f:
    json.dump(data, f, indent=4)

创建完成后，稍等片刻，或刷新页面，点击右上角kernel选择python-3.10.10

2.3 安装依赖库

!pip install transformers==4.30.2
!pip install sentencepiece==0.1.99
!pip install torch==2.0.1
!pip install gradio==3.39 mdtex2html -i https://pypi.tuna.tsinghua.edu.cn/simple --trusted-host pypi.tuna.tsinghua.edu.cn
!cp /home/ma-user/work/frpc_linux_amd64 /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages/gradio/frpc_linux_amd64_v0.2
!chmod +x /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages/gradio/frpc_linux_amd64_v0.2

显示 output

Looking in indexes: http://repo.myhuaweicloud.com/repository/pypi/simple
Requirement already satisfied: transformers==4.30.2 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (4.30.2)
Requirement already satisfied: filelock in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from transformers==4.30.2) (3.12.2)
Requirement already satisfied: huggingface-hub<1.0,>=0.14.1 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from transformers==4.30.2) (0.16.4)
Requirement already satisfied: numpy>=1.17 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from transformers==4.30.2) (1.25.2)
Requirement already satisfied: packaging>=20.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from transformers==4.30.2) (23.2)
Requirement already satisfied: pyyaml>=5.1 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from transformers==4.30.2) (6.0.1)
Requirement already satisfied: regex!=2019.12.17 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from transformers==4.30.2) (2023.5.5)
Requirement already satisfied: requests in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from transformers==4.30.2) (2.31.0)
Requirement already satisfied: tokenizers!=0.11.3,<0.14,>=0.11.1 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from transformers==4.30.2) (0.13.3)
Requirement already satisfied: safetensors>=0.3.1 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from transformers==4.30.2) (0.3.3)
Requirement already satisfied: tqdm>=4.27 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from transformers==4.30.2) (4.66.1)
Requirement already satisfied: fsspec in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.14.1->transformers==4.30.2) (2022.11.0)
Requirement already satisfied: typing-extensions>=3.7.4.3 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.14.1->transformers==4.30.2) (4.8.0)
Requirement already satisfied: charset-normalizer<4,>=2 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from requests->transformers==4.30.2) (3.3.2)
Requirement already satisfied: idna<4,>=2.5 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from requests->transformers==4.30.2) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from requests->transformers==4.30.2) (2.1.0)
Requirement already satisfied: certifi>=2017.4.17 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from requests->transformers==4.30.2) (2023.11.17)
Looking in indexes: http://repo.myhuaweicloud.com/repository/pypi/simple
Requirement already satisfied: sentencepiece==0.1.99 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (0.1.99)
Looking in indexes: http://repo.myhuaweicloud.com/repository/pypi/simple
Requirement already satisfied: torch==2.0.1 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (2.0.1)
Requirement already satisfied: filelock in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from torch==2.0.1) (3.12.2)
Requirement already satisfied: typing-extensions in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from torch==2.0.1) (4.8.0)
Requirement already satisfied: sympy in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from torch==2.0.1) (1.12)
Requirement already satisfied: networkx in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from torch==2.0.1) (2.8.8)
Requirement already satisfied: jinja2 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from torch==2.0.1) (3.1.2)
Requirement already satisfied: nvidia-cuda-nvrtc-cu11==11.7.99 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from torch==2.0.1) (11.7.99)
Requirement already satisfied: nvidia-cuda-runtime-cu11==11.7.99 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from torch==2.0.1) (11.7.99)
Requirement already satisfied: nvidia-cuda-cupti-cu11==11.7.101 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from torch==2.0.1) (11.7.101)
Requirement already satisfied: nvidia-cudnn-cu11==8.5.0.96 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from torch==2.0.1) (8.5.0.96)
Requirement already satisfied: nvidia-cublas-cu11==11.10.3.66 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from torch==2.0.1) (11.10.3.66)
Requirement already satisfied: nvidia-cufft-cu11==10.9.0.58 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from torch==2.0.1) (10.9.0.58)
Requirement already satisfied: nvidia-curand-cu11==10.2.10.91 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from torch==2.0.1) (10.2.10.91)
Requirement already satisfied: nvidia-cusolver-cu11==11.4.0.1 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from torch==2.0.1) (11.4.0.1)
Requirement already satisfied: nvidia-cusparse-cu11==11.7.4.91 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from torch==2.0.1) (11.7.4.91)
Requirement already satisfied: nvidia-nccl-cu11==2.14.3 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from torch==2.0.1) (2.14.3)
Requirement already satisfied: nvidia-nvtx-cu11==11.7.91 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from torch==2.0.1) (11.7.91)
Requirement already satisfied: triton==2.0.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from torch==2.0.1) (2.0.0)
Requirement already satisfied: setuptools in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from nvidia-cublas-cu11==11.10.3.66->torch==2.0.1) (68.0.0)
Requirement already satisfied: wheel in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from nvidia-cublas-cu11==11.10.3.66->torch==2.0.1) (0.41.2)
Requirement already satisfied: cmake in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from triton==2.0.0->torch==2.0.1) (3.27.2)
Requirement already satisfied: lit in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from triton==2.0.0->torch==2.0.1) (16.0.5)
Requirement already satisfied: MarkupSafe>=2.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from jinja2->torch==2.0.1) (2.1.3)
Requirement already satisfied: mpmath>=0.19 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from sympy->torch==2.0.1) (1.3.0)
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Requirement already satisfied: gradio==3.39 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (3.39.0)
Requirement already satisfied: mdtex2html in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (1.2.0)
Requirement already satisfied: aiofiles<24.0,>=22.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio==3.39) (23.2.1)
Requirement already satisfied: aiohttp~=3.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio==3.39) (3.9.1)
Requirement already satisfied: altair<6.0,>=4.2.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio==3.39) (5.2.0)
Requirement already satisfied: fastapi in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio==3.39) (0.105.0)
Requirement already satisfied: ffmpy in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio==3.39) (0.3.1)
Requirement already satisfied: gradio-client>=0.3.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio==3.39) (0.7.0)
Requirement already satisfied: httpx in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio==3.39) (0.25.2)
Requirement already satisfied: huggingface-hub>=0.14.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio==3.39) (0.16.4)
Requirement already satisfied: jinja2<4.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio==3.39) (3.1.2)
Requirement already satisfied: markdown-it-py>=2.0.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from markdown-it-py[linkify]>=2.0.0->gradio==3.39) (2.2.0)
Requirement already satisfied: markupsafe~=2.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio==3.39) (2.1.3)
Requirement already satisfied: matplotlib~=3.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio==3.39) (3.8.2)
Requirement already satisfied: mdit-py-plugins<=0.3.3 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio==3.39) (0.3.3)
Requirement already satisfied: numpy~=1.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio==3.39) (1.25.2)
Requirement already satisfied: orjson~=3.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio==3.39) (3.9.10)
Requirement already satisfied: packaging in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio==3.39) (23.2)
Requirement already satisfied: pandas<3.0,>=1.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio==3.39) (2.1.4)
Requirement already satisfied: pillow<11.0,>=8.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio==3.39) (10.1.0)
Requirement already satisfied: pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,<3.0.0,>=1.7.4 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio==3.39) (2.5.2)
Requirement already satisfied: pydub in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio==3.39) (0.25.1)
Requirement already satisfied: python-multipart in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio==3.39) (0.0.6)
Requirement already satisfied: pyyaml<7.0,>=5.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio==3.39) (6.0.1)
Requirement already satisfied: requests~=2.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio==3.39) (2.31.0)
Requirement already satisfied: semantic-version~=2.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio==3.39) (2.10.0)
Requirement already satisfied: typing-extensions~=4.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio==3.39) (4.8.0)
Requirement already satisfied: uvicorn>=0.14.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio==3.39) (0.24.0.post1)
Requirement already satisfied: websockets<12.0,>=10.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio==3.39) (11.0.3)
Requirement already satisfied: markdown in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from mdtex2html) (3.5.1)
Requirement already satisfied: latex2mathml in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from mdtex2html) (3.77.0)
Requirement already satisfied: attrs>=17.3.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from aiohttp~=3.0->gradio==3.39) (23.1.0)
Requirement already satisfied: multidict<7.0,>=4.5 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from aiohttp~=3.0->gradio==3.39) (6.0.4)
Requirement already satisfied: yarl<2.0,>=1.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from aiohttp~=3.0->gradio==3.39) (1.9.4)
Requirement already satisfied: frozenlist>=1.1.1 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from aiohttp~=3.0->gradio==3.39) (1.4.0)
Requirement already satisfied: aiosignal>=1.1.2 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from aiohttp~=3.0->gradio==3.39) (1.3.1)
Requirement already satisfied: async-timeout<5.0,>=4.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from aiohttp~=3.0->gradio==3.39) (4.0.3)
Requirement already satisfied: jsonschema>=3.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from altair<6.0,>=4.2.0->gradio==3.39) (4.20.0)
Requirement already satisfied: toolz in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from altair<6.0,>=4.2.0->gradio==3.39) (0.12.0)
Requirement already satisfied: fsspec in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from gradio-client>=0.3.0->gradio==3.39) (2022.11.0)
Requirement already satisfied: filelock in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from huggingface-hub>=0.14.0->gradio==3.39) (3.12.2)
Requirement already satisfied: tqdm>=4.42.1 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from huggingface-hub>=0.14.0->gradio==3.39) (4.66.1)
Requirement already satisfied: mdurl~=0.1 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from markdown-it-py>=2.0.0->markdown-it-py[linkify]>=2.0.0->gradio==3.39) (0.1.2)
Requirement already satisfied: linkify-it-py<3,>=1 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from markdown-it-py[linkify]>=2.0.0->gradio==3.39) (2.0.2)
Requirement already satisfied: contourpy>=1.0.1 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from matplotlib~=3.0->gradio==3.39) (1.2.0)
Requirement already satisfied: cycler>=0.10 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from matplotlib~=3.0->gradio==3.39) (0.12.1)
Requirement already satisfied: fonttools>=4.22.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from matplotlib~=3.0->gradio==3.39) (4.46.0)
Requirement already satisfied: kiwisolver>=1.3.1 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from matplotlib~=3.0->gradio==3.39) (1.4.5)
Requirement already satisfied: pyparsing>=2.3.1 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from matplotlib~=3.0->gradio==3.39) (3.1.1)
Requirement already satisfied: python-dateutil>=2.7 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from matplotlib~=3.0->gradio==3.39) (2.8.2)
Requirement already satisfied: pytz>=2020.1 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from pandas<3.0,>=1.0->gradio==3.39) (2023.3.post1)
Requirement already satisfied: tzdata>=2022.1 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from pandas<3.0,>=1.0->gradio==3.39) (2023.3)
Requirement already satisfied: annotated-types>=0.4.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,<3.0.0,>=1.7.4->gradio==3.39) (0.6.0)
Requirement already satisfied: pydantic-core==2.14.5 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,<3.0.0,>=1.7.4->gradio==3.39) (2.14.5)
Requirement already satisfied: charset-normalizer<4,>=2 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from requests~=2.0->gradio==3.39) (3.3.2)
Requirement already satisfied: idna<4,>=2.5 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from requests~=2.0->gradio==3.39) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from requests~=2.0->gradio==3.39) (2.1.0)
Requirement already satisfied: certifi>=2017.4.17 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from requests~=2.0->gradio==3.39) (2023.11.17)
Requirement already satisfied: click>=7.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from uvicorn>=0.14.0->gradio==3.39) (8.1.7)
Requirement already satisfied: h11>=0.8 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from uvicorn>=0.14.0->gradio==3.39) (0.14.0)
Requirement already satisfied: anyio<4.0.0,>=3.7.1 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from fastapi->gradio==3.39) (3.7.1)
Requirement already satisfied: starlette<0.28.0,>=0.27.0 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from fastapi->gradio==3.39) (0.27.0)
Requirement already satisfied: httpcore==1.* in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from httpx->gradio==3.39) (1.0.2)
Requirement already satisfied: sniffio in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from httpx->gradio==3.39) (1.3.0)
Requirement already satisfied: exceptiongroup in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from anyio<4.0.0,>=3.7.1->fastapi->gradio==3.39) (1.2.0)
Requirement already satisfied: jsonschema-specifications>=2023.03.6 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==3.39) (2023.11.2)
Requirement already satisfied: referencing>=0.28.4 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==3.39) (0.32.0)
Requirement already satisfied: rpds-py>=0.7.1 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==3.39) (0.13.2)
Requirement already satisfied: uc-micro-py in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from linkify-it-py<3,>=1->markdown-it-py[linkify]>=2.0.0->gradio==3.39) (1.0.2)
Requirement already satisfied: six>=1.5 in /home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages (from python-dateutil>=2.7->matplotlib~=3.0->gradio==3.39) (1.16.0)

3. 模型测试

采用Gradio方式进行模型测试，测试方法如下：

小提示：本案例最前面关于ChatGLM3的介绍来自于它自己！

# 加载模型
import os
from transformers import AutoTokenizer, AutoModel

work_dir = '/home/ma-user/work'
chatglm_path = os.path.join(work_dir, 'chatglm3-6b')
tokenizer = AutoTokenizer.from_pretrained(chatglm_path, trust_remote_code=True)
model = AutoModel.from_pretrained(chatglm_path, trust_remote_code=True).half().cuda()
model = model.eval()

# 打个招呼
response, history = model.chat(tokenizer, "你好", history=[])
print(response)

/home/ma-user/anaconda3/envs/python-3.10.10/lib/python3.10/site-packages/tqdm/auto.py:21: TqdmWarning: IProgress not found. Please update jupyter and ipywidgets. See https://ipywidgets.readthedocs.io/en/stable/user_install.html
  from .autonotebook import tqdm as notebook_tqdm
Loading checkpoint shards: 100%|██████████| 7/7 [00:07<00:00,  1.07s/it]

你好👋！我是人工智能助手 ChatGLM3-6B，很高兴见到你，欢迎问我任何问题。

# 编写Gradio调用函数
import mdtex2html

#将文本中的字符转为网页上可以支持的字符，避免被误认为是HTML标签
def parse_text(text):
    lines = text.split("\n")
    lines = [line for line in lines if line != ""]
    count = 0
    for i, line in enumerate(lines):
        if "```" in line:
            count += 1
            items = line.split('`')
            if count % 2 == 1:
                lines[i] = f'<pre><code class="language-{items[-1]}">'
            else:
                lines[i] = f'<br></code></pre>'
        else:
            if i > 0:
                if count % 2 == 1:
                    line = line.replace("`", "\`")
                    line = line.replace("<", "&lt;")
                    line = line.replace(">", "&gt;")
                    line = line.replace(" ", "&nbsp;")
                    line = line.replace("*", "&ast;")
                    line = line.replace("_", "&lowbar;")
                    line = line.replace("-", "&#45;")
                    line = line.replace(".", "&#46;")
                    line = line.replace("!", "&#33;")
                    line = line.replace("(", "&#40;")
                    line = line.replace(")", "&#41;")
                    line = line.replace("$", "&#36;")
                lines[i] = "<br>"+line
    text = "".join(lines)
    return text

#采用流聊天方式（stream_chat）调用模型，使得生成答案有逐字生成的效果
def predict(input, chatbot, max_length, top_p, temperature, history, past_key_values):
    chatbot.append((parse_text(input), parse_text(input)))
    for response, history, past_key_values in model.stream_chat(tokenizer, input, history, past_key_values=past_key_values,
                                                                return_past_key_values=True,
                                                                max_length=max_length, top_p=top_p,
                                                                temperature=temperature):
        chatbot[-1] = (parse_text(input), parse_text(response))

        yield chatbot, history, past_key_values

#去除输入框的内容
def reset_user_input():
    return gr.update(value='')

#清除状态
def reset_state():
    return [], [], None

#运行Gradio界面，运行成功后点击“Running on public URL”后的网页链接即可体验
import gradio as gr

with gr.Blocks() as demo:
    gr.HTML("""<h1 align="center">ChatGLM3-6B</h1>""")

    chatbot = gr.Chatbot()
    with gr.Row():
        with gr.Column(scale=4):
            with gr.Column(scale=12):
                user_input = gr.Textbox(show_label=False, placeholder="Input...", lines=10,container=False)
            with gr.Column(min_width=32, scale=1):
                submitBtn = gr.Button("Submit", variant="primary")
        with gr.Column(scale=1):
            emptyBtn = gr.Button("Clear History")
            max_length = gr.Slider(0, 32768, value=8192, step=1.0, label="Maximum length", interactive=True)
            top_p = gr.Slider(0, 1, value=0.8, step=0.01, label="Top P", interactive=True)
            temperature = gr.Slider(0, 1, value=0.95, step=0.01, label="Temperature", interactive=True)

    history = gr.State([])
    past_key_values = gr.State(None)

    submitBtn.click(predict, [user_input, chatbot, max_length, top_p, temperature, history, past_key_values],
                    [chatbot, history, past_key_values], show_progress=True)
    submitBtn.click(reset_user_input, [], [user_input])

    emptyBtn.click(reset_state, outputs=[chatbot, history, past_key_values], show_progress=True)

demo.queue().launch(share=True, inbrowser=True)

Running on local URL:  http://127.0.0.1:7860
Running on public URL: https://bfe1de94c874f88c74.gradio.live

This share link expires in 72 hours. For free permanent hosting and GPU upgrades, run `gradio deploy` from Terminal to deploy to Spaces (https://huggingface.co/spaces)