About 4B/5B

什么是4B/5B编码?

 

      4B/5B编码是百兆以太网中线路层编码类型之一,就是用5bit的二进制数来表示4bit二进制数,映射方式如下表所示:

   About 4B/5B - keendawn - keendawn的博客

 

为什么要进行4B/5B编码?

 

在通信网络中,接收端需要从接收数据中恢复时钟信息来保证同步,这就需要线路中所传输的二进制码流有足够多的跳变,即不能有过多连续的高电平或低电平,否则无法提取时钟信息。

Manchester编码可以保证线路中码流有充分的跳变,因为它是用电平从“-1到“+1的跳变来表示“1,用电平从“+1到“-1的跳变来表示“0,但是这种编码方式的效率太低,只有50%,相当于用线路的有效带宽来换取信号的跳变,十兆以太网就是使用Manchester编码,虽然线路的有效带宽只有10Mbps,但实际带宽却是20Mbps

百兆以太网用的4B/5B编码与MLT-3编码组合方式,发送码流先进行4B/5B编码,再进行MLT-3编码,最后再上线路传输;千兆以太网用的是8B/10B编码与NRZ编码组合方式;万兆以太网用的是64B/66B编码;PCIE 3.0用的是128B/130B编码。


4B/5B编码规则有哪些?

 

4B/5B编码其实就是用5bit的二进制码来代表4bit二进制码。此编码的效率是80%,比Manchester码高。4B/5B编码的目的在前面已经说过了,就是让码流产生足够多的跳变。4位二进制共有16种组合,5位二进制共有32种组合,如何从32种组合种选取16种来使用呢?这里需要满足两个规则:

 

1). 每个5比特码组中不含多于3个“0

2). 或者5比特码组中包含不少于2个“1

 

此规则是怎么来的?这就要从MLT-3的特点来解释了。MLT-3的特点简单的说就是:逢“1”跳变,逢“0”不跳变。为了让4B/5B编码后的码流中有足够多的跳变就需要编码后的码流中有尽量多的“1”和尽量少的“0”。

user@user-HP-Pavilion-Gaming-Desktop-690-07xx:~/Code/Polus/VSB-0804$ source ~/.bashrc user@user-HP-Pavilion-Gaming-Desktop-690-07xx:~/Code/Polus/VSB-0804$ pyenv virtualenv 2.7.18 repo-venv DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support Collecting virtualenv Downloading https://files.pythonhosted.org/packages/6f/43/df7c7b1b7a5ac4e41fac24c3682c1cc32f2c1d683d308bba2500338d1e3e/virtualenv-20.15.1-py2.py3-none-any.whl (10.1MB) |████████████████████████████████| 10.1MB 2.1MB/s Collecting importlib-metadata>=0.12; python_version < "3.8" (from virtualenv) Downloading https://files.pythonhosted.org/packages/cf/b4/877779cd7b5a15536ecbe0655cfb35a0de0ede6d888151fd7356d278c47d/importlib_metadata-2.1.3-py2.py3-none-any.whl Collecting six<2,>=1.9.0 (from virtualenv) Downloading https://files.pythonhosted.org/packages/b7/ce/149a00dd41f10bc29e5921b496af8b574d8413afcd5e30dfa0ed46c2cc5e/six-1.17.0-py2.py3-none-any.whl Collecting platformdirs<3,>=2 (from virtualenv) Downloading https://files.pythonhosted.org/packages/12/57/f4e6d433fba8bde239baa65f626a31fc6d0556a2065fcc81aaa0f4f1507b/platformdirs-2.0.2-py2.py3-none-any.whl Collecting importlib-resources>=1.0; python_version < "3.7" (from virtualenv) Downloading https://files.pythonhosted.org/packages/8d/94/2f6ceee0c4e63bff0177c07e68d27c937a19f6bc77c4739755b49f5adb04/importlib_resources-3.3.1-py2.py3-none-any.whl Collecting filelock<4,>=3.2 (from virtualenv) Downloading https://files.pythonhosted.org/packages/f1/12/585c4d8bef61cd7f9497a021d935ba9fb3127f5e45593c2fcc313897f582/filelock-3.2.1-py2.py3-none-any.whl Collecting distlib<1,>=0.3.1 (from virtualenv) Downloading https://files.pythonhosted.org/packages/33/6b/e0547afaf41bf2c42e52430072fa5658766e3d65bd4b03a563d1b6336f57/distlib-0.4.0-py2.py3-none-any.whl (469kB) |████████████████████████████████| 471kB 3.5MB/s Collecting pathlib2<3,>=2.3.3; python_version < "3.4" and sys_platform != "win32" (from virtualenv) Downloading https://files.pythonhosted.org/packages/09/eb/4af4bcd5b8731366b676192675221c5324394a580dfae469d498313b5c4a/pathlib2-2.3.7.post1-py2.py3-none-any.whl Collecting configparser>=3.5; python_version < "3" (from importlib-metadata>=0.12; python_version < "3.8"->virtualenv) Downloading https://files.pythonhosted.org/packages/7a/2a/95ed0501cf5d8709490b1d3a3f9b5cf340da6c433f896bbe9ce08dbe6785/configparser-4.0.2-py2.py3-none-any.whl Collecting zipp>=0.5 (from importlib-metadata>=0.12; python_version < "3.8"->virtualenv) Downloading https://files.pythonhosted.org/packages/96/0a/67556e9b7782df7118c1f49bdc494da5e5e429c93aa77965f33e81287c8c/zipp-1.2.0-py2.py3-none-any.whl Collecting contextlib2; python_version < "3" (from importlib-metadata>=0.12; python_version < "3.8"->virtualenv) Downloading https://files.pythonhosted.org/packages/85/60/370352f7ef6aa96c52fb001831622f50f923c1d575427d021b8ab3311236/contextlib2-0.6.0.post1-py2.py3-none-any.whl Collecting typing; python_version < "3.5" (from importlib-resources>=1.0; python_version < "3.7"->virtualenv) Downloading https://files.pythonhosted.org/packages/0b/cb/da856e81731833b94da70a08712f658416266a5fb2a9d9e426c8061becef/typing-3.10.0.0-py2-none-any.whl Collecting singledispatch; python_version < "3.4" (from importlib-resources>=1.0; python_version < "3.7"->virtualenv) Downloading https://files.pythonhosted.org/packages/3f/09/2a17c6505a8373229cb3de6161e3af74ff90afcf4516719aa6cf32fad151/singledispatch-3.7.0-py2.py3-none-any.whl Collecting scandir; python_version < "3.5" (from pathlib2<3,>=2.3.3; python_version < "3.4" and sys_platform != "win32"->virtualenv) Downloading https://files.pythonhosted.org/packages/df/f5/9c052db7bd54d0cbf1bc0bb6554362bba1012d03e5888950a4f5c5dadc4e/scandir-1.10.0.tar.gz Installing collected packages: configparser, contextlib2, zipp, six, typing, scandir, pathlib2, importlib-metadata, platformdirs, singledispatch, importlib-resources, filelock, distlib, virtualenv Running setup.py install for scandir ... done Successfully installed configparser-4.0.2 contextlib2-0.6.0.post1 distlib-0.4.0 filelock-3.2.1 importlib-metadata-2.1.3 importlib-resources-3.3.1 pathlib2-2.3.7.post1 platformdirs-2.0.2 scandir-1.10.0 singledispatch-3.7.0 six-1.17.0 typing-3.10.0.0 virtualenv-20.15.1 zipp-1.2.0 WARNING: You are using pip version 19.2.3, however version 20.3.4 is available. You should consider upgrading via the 'pip install --upgrade pip' command. created virtual environment CPython2.7.18.final.0-64 in 729ms creator CPython2Posix(dest=/home/user/.pyenv/versions/2.7.18/envs/repo-venv, clear=False, no_vcs_ignore=False, global=False) seeder FromAppData(download=False, pip=bundle, wheel=bundle, setuptools=bundle, via=copy, app_data_dir=/home/user/.local/share/virtualenv) added seed packages: pip==20.3.4, setuptools==44.1.1, wheel==0.37.1 activators NushellActivator,PythonActivator,FishActivator,CShellActivator,PowerShellActivator,BashActivator Looking in links: /tmp/tmpNN1XZW Requirement already satisfied: setuptools in /home/user/.pyenv/versions/2.7.18/envs/repo-venv/lib/python2.7/site-packages (44.1.1) Requirement already satisfied: pip in /home/user/.pyenv/versions/2.7.18/envs/repo-venv/lib/python2.7/site-packages (20.3.4) user@user-HP-Pavilion-Gaming-Desktop-690-07xx:~/Code/Polus/VSB-0804$ wget https://raw.githubusercontent.com/python/cpython/2.7/Lib/formatter.py -O $VIRTUAL_ENV/lib/python2.7/site-packages/formatter.py /lib/python2.7/site-packages/formatter.py: No such file or directory user@user-HP-Pavilion-Gaming-Desktop-690-07xx:~/Code/Polus/VSB-0804$
08-06
[2025-10-09T07:39:28.999Z] change_url: http://gerrit.scm.adc.com:8080/#/c/40424682/1 cherry_pick_result_dict: Successfully [2025-10-09T07:39:28.999Z] change_url: http://gerrit.scm.adc.com:8080/#/c/40526967/2 cherry_pick_result_dict: Successfully [2025-10-09T07:39:28.999Z] Traceback (most recent call last): [2025-10-09T07:39:28.999Z] File "build_stage/download.py", line 43, in <module> [2025-10-09T07:39:28.999Z] main() [2025-10-09T07:39:28.999Z] File "/work/0004/workspace/Build_S_BP/24173/script/common/utils.py", line 549, in wrapper [2025-10-09T07:39:28.999Z] _update_timing_field(es, index_name, duration, timing_field) [2025-10-09T07:39:28.999Z] File "/work/0004/workspace/Build_S_BP/24173/script/common/utils.py", line 416, in _update_timing_field [2025-10-09T07:39:28.999Z] search_res = es.search(index=index_name, body=query, size=1) [2025-10-09T07:39:28.999Z] File "/usr/local/lib/python2.7/dist-packages/elasticsearch/client/utils.py", line 347, in _wrapped [2025-10-09T07:39:28.999Z] return func(*args, params=params, headers=headers, **kwargs) [2025-10-09T07:39:28.999Z] File "/usr/local/lib/python2.7/dist-packages/elasticsearch/client/__init__.py", line 1826, in search [2025-10-09T07:39:28.999Z] body=body, [2025-10-09T07:39:28.999Z] File "/usr/local/lib/python2.7/dist-packages/elasticsearch/transport.py", line 466, in perform_request [2025-10-09T07:39:28.999Z] raise e [2025-10-09T07:39:28.999Z] elasticsearch.exceptions.NotFoundError: NotFoundError(404, u'index_not_found_exception', u'no such index [chip_components_2025_10]', chip_components_2025_10, index_or_alias) [Pipeline] } [Pipeline] // stage [Pipeline] echo [2025-10-09T07:39:29.059Z] hudson.AbortException: script returned exit code 1 [Pipeline] stage [Pipeline] { (package) [Pipeline] sh [2025-10-09T07:39:29.412Z] + cd /work/0004/workspace/Build_S_BP/24173/script/build_t/bp/ [2025-10-09T07:39:29.412Z] + python -O build_stage/package.py [2025-10-09T07:39:29.668Z] [BUILD_LOG 2025-10-09 15:39:29,489 INFO] tag.py-getTagInfo: tag_info = {'static_apk_url': '', 'apk_absolute_path': '', 'xml_absolute_path': 'http://gpw14.myoas.com:80/artifactory/manifest-snapshot-local/202509/s-v-release-15.0.2/bp/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_jfrogpath': '', 'compile_xml_tag': 'ab98c80f9a8d196c81d6b9f907fe676cc808629b', 'script_tag': '383e6a963f573fbcd8ef751088365f352c440a16', 'xml_relative_path': 'XML_INFO/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_tag': '', 'static_apk_name': '', 'tag_type': 'ini'} [2025-10-09T07:39:29.668Z] [BUILD_LOG 2025-10-09 15:39:29,491 INFO] tag.py-getTagInfo: [TAGINFO] tag_info = {'static_apk_url': '', 'apklistPatch': [], 'apk_absolute_path': '', 'xml_absolute_path': 'http://gpw14.myoas.com:80/artifactory/manifest-snapshot-local/202509/s-v-release-15.0.2/bp/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_jfrogpath': '', 'codePatch': [u'http://gerrit.scm.adc.com:8080/#/c/40424682/1', u'http://gerrit.scm.adc.com:8080/#/c/40526967/2'], 'compile_xml_tag': 'ab98c80f9a8d196c81d6b9f907fe676cc808629b', 'script_tag': '383e6a963f573fbcd8ef751088365f352c440a16', 'modemPatch': {}, 'xml_relative_path': 'XML_INFO/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_tag': '', 'static_apk_name': '', 'tag_type': 'ini'} [2025-10-09T07:39:29.668Z] [BUILD_LOG 2025-10-09 15:39:29,509 ERROR] utils.py-Copy: source /work/0004/workspace/Build_S_BP/24173/code/source/bp/target_elfs/about.html doesn't exits [2025-10-09T07:39:29.668Z] [BUILD_LOG 2025-10-09 15:39:29,509 INFO] package.py-__init__: Package init... [2025-10-09T07:39:29.668Z] BPEnvVariable getIdentifier [2025-10-09T07:39:29.668Z] sql_cmd is : select isSupportReuseVersion from CCM_S2_0_Build_S_BP where ccmBuildHistoryId='33458282' [2025-10-09T07:39:29.668Z] [INFO]reuseBaseCcmBuildHistoryId is: None [2025-10-09T07:39:29.668Z] [tagInfo]tag_info['modemPatch'] is: {} [2025-10-09T07:39:29.668Z] self.TAGINFO = {'static_apk_url': '', 'apklistPatch': [], 'apk_absolute_path': '', 'xml_absolute_path': 'http://gpw14.myoas.com:80/artifactory/manifest-snapshot-local/202509/s-v-release-15.0.2/bp/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_jfrogpath': '', 'codePatch': [u'http://gerrit.scm.adc.com:8080/#/c/40424682/1', u'http://gerrit.scm.adc.com:8080/#/c/40526967/2'], 'compile_xml_tag': 'ab98c80f9a8d196c81d6b9f907fe676cc808629b', 'script_tag': '383e6a963f573fbcd8ef751088365f352c440a16', 'modemPatch': {}, 'xml_relative_path': 'XML_INFO/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_tag': '', 'static_apk_name': '', 'tag_type': 'ini'} [2025-10-09T07:39:29.668Z] soc is: MTK [2025-10-09T07:39:29.668Z] bp_path_name is: bp [2025-10-09T07:39:29.668Z] [INFO]remote_build_type is: False [2025-10-09T07:39:29.668Z] [ES] Successfully connected to Elasticsearch [2025-10-09T07:39:29.668Z] Traceback (most recent call last): [2025-10-09T07:39:29.668Z] File "build_stage/package.py", line 43, in <module> [2025-10-09T07:39:29.668Z] main() [2025-10-09T07:39:29.668Z] File "/work/0004/workspace/Build_S_BP/24173/script/common/utils.py", line 542, in wrapper [2025-10-09T07:39:29.668Z] _update_es_status(es, index_name, index_type, build_level) [2025-10-09T07:39:29.668Z] File "/work/0004/workspace/Build_S_BP/24173/script/common/utils.py", line 384, in _update_es_status [2025-10-09T07:39:29.668Z] search_res = es.search(index=index_name, body=query, size=1) [2025-10-09T07:39:29.668Z] File "/usr/local/lib/python2.7/dist-packages/elasticsearch/client/utils.py", line 347, in _wrapped [2025-10-09T07:39:29.668Z] return func(*args, params=params, headers=headers, **kwargs) [2025-10-09T07:39:29.668Z] File "/usr/local/lib/python2.7/dist-packages/elasticsearch/client/__init__.py", line 1826, in search [2025-10-09T07:39:29.668Z] body=body, [2025-10-09T07:39:29.668Z] File "/usr/local/lib/python2.7/dist-packages/elasticsearch/transport.py", line 466, in perform_request [2025-10-09T07:39:29.668Z] raise e [2025-10-09T07:39:29.668Z] elasticsearch.exceptions.NotFoundError: NotFoundError(404, u'index_not_found_exception', u'no such index [chip_components_2025_10]', chip_components_2025_10, index_or_alias) [Pipeline] } [Pipeline] // stage [Pipeline] echo [2025-10-09T07:39:29.718Z] hudson.AbortException: script returned exit code 1 [Pipeline] stage [Pipeline] { (archive) [Pipeline] sh [2025-10-09T07:39:30.067Z] + cd /work/0004/workspace/Build_S_BP/24173/script/build_t/bp/ [2025-10-09T07:39:30.067Z] + python -O build_stage/archive_jfrog.py [2025-10-09T07:39:30.323Z] [BUILD_LOG 2025-10-09 15:39:30,168 INFO] tag.py-getTagInfo: tag_info = {'static_apk_url': '', 'apk_absolute_path': '', 'xml_absolute_path': 'http://gpw14.myoas.com:80/artifactory/manifest-snapshot-local/202509/s-v-release-15.0.2/bp/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_jfrogpath': '', 'compile_xml_tag': 'ab98c80f9a8d196c81d6b9f907fe676cc808629b', 'script_tag': '383e6a963f573fbcd8ef751088365f352c440a16', 'xml_relative_path': 'XML_INFO/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_tag': '', 'static_apk_name': '', 'tag_type': 'ini'} [2025-10-09T07:39:30.323Z] [BUILD_LOG 2025-10-09 15:39:30,169 INFO] tag.py-getTagInfo: [TAGINFO] tag_info = {'static_apk_url': '', 'apklistPatch': [], 'apk_absolute_path': '', 'xml_absolute_path': 'http://gpw14.myoas.com:80/artifactory/manifest-snapshot-local/202509/s-v-release-15.0.2/bp/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_jfrogpath': '', 'codePatch': [u'http://gerrit.scm.adc.com:8080/#/c/40424682/1', u'http://gerrit.scm.adc.com:8080/#/c/40526967/2'], 'compile_xml_tag': 'ab98c80f9a8d196c81d6b9f907fe676cc808629b', 'script_tag': '383e6a963f573fbcd8ef751088365f352c440a16', 'modemPatch': {}, 'xml_relative_path': 'XML_INFO/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_tag': '', 'static_apk_name': '', 'tag_type': 'ini'} [2025-10-09T07:39:30.323Z] [Info] [Thread 15] Uploading artifact: common/tag.ini [2025-10-09T07:39:30.323Z] [Info] [Thread 7] Uploading artifact: common/compile_detail.info [2025-10-09T07:39:30.323Z] [Info] [Thread 8] Uploading artifact: common/compile.info [2025-10-09T07:39:30.578Z] [Info] Setting properties... [2025-10-09T07:39:30.578Z] [Info] [Thread 2] Setting properties on: component-bp-snapshot-local/patch/cellPhone/Android15/MT6835/Release_Maintain/00.1.00015023/00.1.00015023-20251009152520-33837650/ [2025-10-09T07:39:30.835Z] [Info] Done setting properties. [2025-10-09T07:39:30.835Z] { [2025-10-09T07:39:30.835Z] "status": "success", [2025-10-09T07:39:30.835Z] "totals": { [2025-10-09T07:39:30.835Z] "success": 1, [2025-10-09T07:39:30.835Z] "failure": 0 [2025-10-09T07:39:30.835Z] } [2025-10-09T07:39:30.835Z] } [2025-10-09T07:39:30.835Z] [BUILD_LOG 2025-10-09 15:39:30,639 INFO] utils.py-CountTime: main cost time: 0m 0s [2025-10-09T07:39:30.835Z] BPEnvVariable getIdentifier [2025-10-09T07:39:30.835Z] sql_cmd is : select isSupportReuseVersion from CCM_S2_0_Build_S_BP where ccmBuildHistoryId='33458282' [2025-10-09T07:39:30.835Z] [INFO]reuseBaseCcmBuildHistoryId is: None [2025-10-09T07:39:30.835Z] [tagInfo]tag_info['modemPatch'] is: {} [2025-10-09T07:39:30.835Z] self.TAGINFO = {'static_apk_url': '', 'apklistPatch': [], 'apk_absolute_path': '', 'xml_absolute_path': 'http://gpw14.myoas.com:80/artifactory/manifest-snapshot-local/202509/s-v-release-15.0.2/bp/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_jfrogpath': '', 'codePatch': [u'http://gerrit.scm.adc.com:8080/#/c/40424682/1', u'http://gerrit.scm.adc.com:8080/#/c/40526967/2'], 'compile_xml_tag': 'ab98c80f9a8d196c81d6b9f907fe676cc808629b', 'script_tag': '383e6a963f573fbcd8ef751088365f352c440a16', 'modemPatch': {}, 'xml_relative_path': 'XML_INFO/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_tag': '', 'static_apk_name': '', 'tag_type': 'ini'} [2025-10-09T07:39:30.835Z] soc is: MTK [2025-10-09T07:39:30.835Z] bp_path_name is: bp [2025-10-09T07:39:30.835Z] [INFO]remote_build_type is: False [2025-10-09T07:39:30.835Z] [ES] Successfully connected to Elasticsearch [2025-10-09T07:39:30.835Z] ---------2025-10-09 15:39:30,Upload Jfrog start ...---------- [2025-10-09T07:39:30.835Z] [JFrog cmd:] /work/jfrog rt u ./ component-bp-snapshot-local/patch/cellPhone/Android15/MT6835/Release_Maintain/00.1.00015023/00.1.00015023-20251009152520-33837650/ --url=http://gpw21.myoas.com/artifactory --user=**** --password=**** --retries=6 --threads=16 --flat=false --include-dirs --symlinks=true --exclusions="*.md5;*.sha256;*.sha1;r_ini_lock" > /work/0004/workspace/Build_S_BP/24173/code/08529088ac93fa0454c6c4d885178d8206d380748a01b52af5b4b7d70da93e28 [2025-10-09T07:39:30.835Z] j_upload_log for /work/0004/workspace/Build_S_BP/24173/package is : { [2025-10-09T07:39:30.835Z] "status": "success", [2025-10-09T07:39:30.835Z] "totals": { [2025-10-09T07:39:30.835Z] "success": 3, [2025-10-09T07:39:30.835Z] "failure": 0 [2025-10-09T07:39:30.835Z] } [2025-10-09T07:39:30.835Z] } [2025-10-09T07:39:30.835Z] [2025-10-09T07:39:30.835Z] ---------2025-10-09 15:39:30,Upload Jfrog end ...---------- [2025-10-09T07:39:30.835Z] [JFrog cmd:] /work/jfrog rt sp component-bp-snapshot-local/patch/cellPhone/Android15/MT6835/Release_Maintain/00.1.00015023/00.1.00015023-20251009152520-33837650 "JENKINS_BUILD_URL=http://10.234.27.234:8089/jenkins/job/Build_S_BP/24173/;version=00.1.00015023.2025100915252033837650;versionType=release;ccm_url=https://noah.myoas.com/micro-app/ccm/template/soc?id\=199601&componentType\=BP&indexTab\=all&isFromDrawer\=true&FromRecord\=socDetail&vendor\=MT6835&activeTab\=buildRecord&recordId\=33837650&componentHistoryId\=33837650&FromInnerRecord\=socBuildDetail;expireDate=2025-11-12;isTagPatchVersion=true" --include-dirs --url=http://gpw21.myoas.com/artifactory --user=**** --password=**** --recursive=false [2025-10-09T07:39:30.835Z] Traceback (most recent call last): [2025-10-09T07:39:30.835Z] File "build_stage/archive_jfrog.py", line 29, in <module> [2025-10-09T07:39:30.835Z] main() [2025-10-09T07:39:30.835Z] File "/work/0004/workspace/Build_S_BP/24173/script/common/utils.py", line 549, in wrapper [2025-10-09T07:39:30.835Z] _update_timing_field(es, index_name, duration, timing_field) [2025-10-09T07:39:30.835Z] File "/work/0004/workspace/Build_S_BP/24173/script/common/utils.py", line 416, in _update_timing_field [2025-10-09T07:39:30.835Z] search_res = es.search(index=index_name, body=query, size=1) [2025-10-09T07:39:30.835Z] File "/usr/local/lib/python2.7/dist-packages/elasticsearch/client/utils.py", line 347, in _wrapped [2025-10-09T07:39:30.835Z] return func(*args, params=params, headers=headers, **kwargs) [2025-10-09T07:39:30.835Z] File "/usr/local/lib/python2.7/dist-packages/elasticsearch/client/__init__.py", line 1826, in search [2025-10-09T07:39:30.835Z] body=body, [2025-10-09T07:39:30.835Z] File "/usr/local/lib/python2.7/dist-packages/elasticsearch/transport.py", line 466, in perform_request [2025-10-09T07:39:30.835Z] raise e [2025-10-09T07:39:30.835Z] elasticsearch.exceptions.NotFoundError: NotFoundError(404, u'index_not_found_exception', u'no such index [chip_components_2025_10]', chip_components_2025_10, index_or_alias) [Pipeline] } [Pipeline] // stage [Pipeline] echo [2025-10-09T07:39:30.893Z] hudson.AbortException: script returned exit code 1 [Pipeline] stage [Pipeline] { (callback) [Pipeline] sh [2025-10-09T07:39:31.216Z] + cd /work/0004/workspace/Build_S_BP/24173/script/build_t/bp/ [2025-10-09T07:39:31.216Z] + python -O build_stage/callback_ccm.py --build_stop [2025-10-09T07:39:31.472Z] [BUILD_LOG 2025-10-09 15:39:31,291 INFO] tag.py-getTagInfo: tag_info = {'static_apk_url': '', 'apk_absolute_path': '', 'xml_absolute_path': 'http://gpw14.myoas.com:80/artifactory/manifest-snapshot-local/202509/s-v-release-15.0.2/bp/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_jfrogpath': '', 'compile_xml_tag': 'ab98c80f9a8d196c81d6b9f907fe676cc808629b', 'script_tag': '383e6a963f573fbcd8ef751088365f352c440a16', 'xml_relative_path': 'XML_INFO/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_tag': '', 'static_apk_name': '', 'tag_type': 'ini'} [2025-10-09T07:39:31.472Z] [BUILD_LOG 2025-10-09 15:39:31,294 INFO] tag.py-getTagInfo: [TAGINFO] tag_info = {'static_apk_url': '', 'apklistPatch': [], 'apk_absolute_path': '', 'xml_absolute_path': 'http://gpw14.myoas.com:80/artifactory/manifest-snapshot-local/202509/s-v-release-15.0.2/bp/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_jfrogpath': '', 'codePatch': [u'http://gerrit.scm.adc.com:8080/#/c/40424682/1', u'http://gerrit.scm.adc.com:8080/#/c/40526967/2'], 'compile_xml_tag': 'ab98c80f9a8d196c81d6b9f907fe676cc808629b', 'script_tag': '383e6a963f573fbcd8ef751088365f352c440a16', 'modemPatch': {}, 'xml_relative_path': 'XML_INFO/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_tag': '', 'static_apk_name': '', 'tag_type': 'ini'} [2025-10-09T07:39:31.472Z] [BUILD_LOG 2025-10-09 15:39:31,324 INFO] static_xml.py-__init__: static_xml_file = /work/0004/workspace/Build_S_BP/24173/code/source/bp/MT6835_bp_202510091528f48099_user.xml [2025-10-09T07:39:31.472Z] [BUILD_LOG 2025-10-09 15:39:31,324 INFO] callback_ccm.py-callback_ccm: ccm callback cmd is : curl -H "Content-Type:application/json" -w ' [2025-10-09T07:39:31.472Z] callback_result:%{http_code} [2025-10-09T07:39:31.473Z] ' --max-time 60 -XPOST -H "x-token:2c6ebc3e7cba9267b509defcb559803f" https://panter.myoas.com/api/v1/components -d '{"xml_absolute_path": "http://gpw14.myoas.com:80/artifactory/manifest-snapshot-local/202510/s-v-release-15.0.2/bp/MT6835_bp_202510091528f48099_user.xml", "repo_init_command": "repo init -u ssh://gerrit.scm.adc.com:29418/oplus/platform/manifest -b v/release-15.0.2 -m BP/bp_mt6835_24e_nr17r1mp5_maintain-14.1.xml --repo-branch=update --reference=/work/oppo_mirror --no-repo-verify;", "component_result": "fail", "build_parma": {"componentType": "BP", "pipeline": {"resultCallbackUrl": "http://gcode-ccm-api.myoas.com/component-service/external/callback/component/jenkins-build-result/33837650", "ccm_component_hash_fixed_callback_url": "https://gcode-ccm-api.myoas.com/single-service/jenkins/callback/component/record/hashFixed/33837650", "expireDate": "2025-11-12", "ccmBuildHistoryId": "33837650", "ccmUrl": "https://noah.myoas.com/micro-app/ccm/template/soc?id=199601&componentType=BP&indexTab=all&isFromDrawer=true&FromRecord=socDetail&vendor=MT6835&activeTab=buildRecord&recordId=33837650&componentHistoryId=33837650&FromInnerRecord=socBuildDetail", "buildTimeCallbackUrl": "http://gcode-ccm-api.myoas.com/component-service/external/callback/component/buildTime/component/33837650", "startTime": "20251009152520", "isSupportReuseVersion": "true", "jenkinEnv": "prod", "submitUsername": "V96817792", "purpose": "general"}, "patchInfo": {"baseCcmBuildHistoryId": "33458282", "patchSet": [{"type": "code", "gerritUrl": "http://gerrit.scm.adc.com:8080/#/c/40424682/1"}, {"type": "code", "gerritUrl": "http://gerrit.scm.adc.com:8080/#/c/40526967/2"}], "baseVersionAddress": "http://gpw21.myoas.com/artifactory/component-bp-snapshot-local/patch/cellPhone/Android15/MT6835/Release_Maintain/00.1.00015023/00.1.00015023-20250919233722-33458282/"}, "prop": {"OPLUS_CCM_PLATFORM": "MT6835", "OPLUS_CCM_VERSION_TYPE": "release", "OPLUS_CCM_XML_NAME": "BP/bp_mt6835_24e_nr17r1mp5_maintain-14.1.xml", "OPLUS_CCM_CFG_FILE": "bp/mt6835/bp_compile.xml", "OPLUS_CCM_DOWNLOAD_CODE_BY_GROUP": "false", "OPLUS_CCM_CFG_BRANCH": "v/release-15.0.2", "OPLUS_CCM_JFROG_URL": "http://gpw21.myoas.com/artifactory/component-bp-snapshot-local/patch/cellPhone/Android15/MT6835/Release_Maintain/00.1.00015023/00.1.00015023-20251009152520-33837650/", "OPLUS_CCM_BASE_URL": "oplus/platform/manifest", "OPLUS_CCM_LIMIT_ANDROID_API_LEVEL": "35", "OPLUS_CCM_CALCULATE_VSDK_HASH": "true", "OPLUS_CCM_BRANCH_TYPE": "Release_Maintain", "OPLUS_CCM_MANIFEST_BRANCH": "v/release-15.0.2", "OPLUS_CCM_SOC": "MTK", "OPLUS_CCM_COMPONENT_VERSION": "00.1.00015023.2025100915252033837650", "OPLUS_CCM_GERRIT_HOST": "http://gerrit.scm.adc.com:8080"}}}' [2025-10-09T07:39:31.473Z] % Total % Received % Xferd Average Speed Time Time Time Current [2025-10-09T07:39:31.473Z] Dload Upload Total Spent Left Speed [2025-10-09T07:39:31.473Z] 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 2625 100 21 100 2604 165 20512 --:--:-- --:--:-- --:--:-- 20666 [2025-10-09T07:39:31.728Z] [BUILD_LOG 2025-10-09 15:39:31,470 INFO] callback_ccm.py-callback_ccm: ccm callback cmd result :Internal Server Error [2025-10-09T07:39:31.728Z] callback_result:500 [2025-10-09T07:39:31.728Z] [2025-10-09T07:39:32.656Z] [BUILD_LOG 2025-10-09 15:39:32,471 INFO] callback_ccm.py-callback_ccm: ccm callback cmd is : curl -H "Content-Type:application/json" -w ' [2025-10-09T07:39:32.656Z] callback_result:%{http_code} [2025-10-09T07:39:32.656Z] ' --max-time 60 -XPOST -H "x-token:2c6ebc3e7cba9267b509defcb559803f" https://panter.myoas.com/api/v1/components -d '{"xml_absolute_path": "http://gpw14.myoas.com:80/artifactory/manifest-snapshot-local/202510/s-v-release-15.0.2/bp/MT6835_bp_202510091528f48099_user.xml", "repo_init_command": "repo init -u ssh://gerrit.scm.adc.com:29418/oplus/platform/manifest -b v/release-15.0.2 -m BP/bp_mt6835_24e_nr17r1mp5_maintain-14.1.xml --repo-branch=update --reference=/work/oppo_mirror --no-repo-verify;", "component_result": "fail", "build_parma": {"componentType": "BP", "pipeline": {"resultCallbackUrl": "http://gcode-ccm-api.myoas.com/component-service/external/callback/component/jenkins-build-result/33837650", "ccm_component_hash_fixed_callback_url": "https://gcode-ccm-api.myoas.com/single-service/jenkins/callback/component/record/hashFixed/33837650", "expireDate": "2025-11-12", "ccmBuildHistoryId": "33837650", "ccmUrl": "https://noah.myoas.com/micro-app/ccm/template/soc?id=199601&componentType=BP&indexTab=all&isFromDrawer=true&FromRecord=socDetail&vendor=MT6835&activeTab=buildRecord&recordId=33837650&componentHistoryId=33837650&FromInnerRecord=socBuildDetail", "buildTimeCallbackUrl": "http://gcode-ccm-api.myoas.com/component-service/external/callback/component/buildTime/component/33837650", "startTime": "20251009152520", "isSupportReuseVersion": "true", "jenkinEnv": "prod", "submitUsername": "V96817792", "purpose": "general"}, "patchInfo": {"baseCcmBuildHistoryId": "33458282", "patchSet": [{"type": "code", "gerritUrl": "http://gerrit.scm.adc.com:8080/#/c/40424682/1"}, {"type": "code", "gerritUrl": "http://gerrit.scm.adc.com:8080/#/c/40526967/2"}], "baseVersionAddress": "http://gpw21.myoas.com/artifactory/component-bp-snapshot-local/patch/cellPhone/Android15/MT6835/Release_Maintain/00.1.00015023/00.1.00015023-20250919233722-33458282/"}, "prop": {"OPLUS_CCM_PLATFORM": "MT6835", "OPLUS_CCM_VERSION_TYPE": "release", "OPLUS_CCM_XML_NAME": "BP/bp_mt6835_24e_nr17r1mp5_maintain-14.1.xml", "OPLUS_CCM_CFG_FILE": "bp/mt6835/bp_compile.xml", "OPLUS_CCM_DOWNLOAD_CODE_BY_GROUP": "false", "OPLUS_CCM_CFG_BRANCH": "v/release-15.0.2", "OPLUS_CCM_JFROG_URL": "http://gpw21.myoas.com/artifactory/component-bp-snapshot-local/patch/cellPhone/Android15/MT6835/Release_Maintain/00.1.00015023/00.1.00015023-20251009152520-33837650/", "OPLUS_CCM_BASE_URL": "oplus/platform/manifest", "OPLUS_CCM_LIMIT_ANDROID_API_LEVEL": "35", "OPLUS_CCM_CALCULATE_VSDK_HASH": "true", "OPLUS_CCM_BRANCH_TYPE": "Release_Maintain", "OPLUS_CCM_MANIFEST_BRANCH": "v/release-15.0.2", "OPLUS_CCM_SOC": "MTK", "OPLUS_CCM_COMPONENT_VERSION": "00.1.00015023.2025100915252033837650", "OPLUS_CCM_GERRIT_HOST": "http://gerrit.scm.adc.com:8080"}}}' [2025-10-09T07:39:32.656Z] % Total % Received % Xferd Average Speed Time Time Time Current [2025-10-09T07:39:32.656Z] Dload Upload Total Spent Left Speed [2025-10-09T07:39:32.656Z] 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 2625 100 21 100 2604 160 19942 --:--:-- --:--:-- --:--:-- 20030 [2025-10-09T07:39:32.656Z] [BUILD_LOG 2025-10-09 15:39:32,619 INFO] callback_ccm.py-callback_ccm: ccm callback cmd result :Internal Server Error [2025-10-09T07:39:32.656Z] callback_result:500 [2025-10-09T07:39:32.656Z] [2025-10-09T07:39:34.020Z] [BUILD_LOG 2025-10-09 15:39:33,621 INFO] callback_ccm.py-callback_ccm: ccm callback cmd is : curl -H "Content-Type:application/json" -w ' [2025-10-09T07:39:34.020Z] callback_result:%{http_code} [2025-10-09T07:39:34.021Z] ' --max-time 60 -XPOST -H "x-token:2c6ebc3e7cba9267b509defcb559803f" https://panter.myoas.com/api/v1/components -d '{"xml_absolute_path": "http://gpw14.myoas.com:80/artifactory/manifest-snapshot-local/202510/s-v-release-15.0.2/bp/MT6835_bp_202510091528f48099_user.xml", "repo_init_command": "repo init -u ssh://gerrit.scm.adc.com:29418/oplus/platform/manifest -b v/release-15.0.2 -m BP/bp_mt6835_24e_nr17r1mp5_maintain-14.1.xml --repo-branch=update --reference=/work/oppo_mirror --no-repo-verify;", "component_result": "fail", "build_parma": {"componentType": "BP", "pipeline": {"resultCallbackUrl": "http://gcode-ccm-api.myoas.com/component-service/external/callback/component/jenkins-build-result/33837650", "ccm_component_hash_fixed_callback_url": "https://gcode-ccm-api.myoas.com/single-service/jenkins/callback/component/record/hashFixed/33837650", "expireDate": "2025-11-12", "ccmBuildHistoryId": "33837650", "ccmUrl": "https://noah.myoas.com/micro-app/ccm/template/soc?id=199601&componentType=BP&indexTab=all&isFromDrawer=true&FromRecord=socDetail&vendor=MT6835&activeTab=buildRecord&recordId=33837650&componentHistoryId=33837650&FromInnerRecord=socBuildDetail", "buildTimeCallbackUrl": "http://gcode-ccm-api.myoas.com/component-service/external/callback/component/buildTime/component/33837650", "startTime": "20251009152520", "isSupportReuseVersion": "true", "jenkinEnv": "prod", "submitUsername": "V96817792", "purpose": "general"}, "patchInfo": {"baseCcmBuildHistoryId": "33458282", "patchSet": [{"type": "code", "gerritUrl": "http://gerrit.scm.adc.com:8080/#/c/40424682/1"}, {"type": "code", "gerritUrl": "http://gerrit.scm.adc.com:8080/#/c/40526967/2"}], "baseVersionAddress": "http://gpw21.myoas.com/artifactory/component-bp-snapshot-local/patch/cellPhone/Android15/MT6835/Release_Maintain/00.1.00015023/00.1.00015023-20250919233722-33458282/"}, "prop": {"OPLUS_CCM_PLATFORM": "MT6835", "OPLUS_CCM_VERSION_TYPE": "release", "OPLUS_CCM_XML_NAME": "BP/bp_mt6835_24e_nr17r1mp5_maintain-14.1.xml", "OPLUS_CCM_CFG_FILE": "bp/mt6835/bp_compile.xml", "OPLUS_CCM_DOWNLOAD_CODE_BY_GROUP": "false", "OPLUS_CCM_CFG_BRANCH": "v/release-15.0.2", "OPLUS_CCM_JFROG_URL": "http://gpw21.myoas.com/artifactory/component-bp-snapshot-local/patch/cellPhone/Android15/MT6835/Release_Maintain/00.1.00015023/00.1.00015023-20251009152520-33837650/", "OPLUS_CCM_BASE_URL": "oplus/platform/manifest", "OPLUS_CCM_LIMIT_ANDROID_API_LEVEL": "35", "OPLUS_CCM_CALCULATE_VSDK_HASH": "true", "OPLUS_CCM_BRANCH_TYPE": "Release_Maintain", "OPLUS_CCM_MANIFEST_BRANCH": "v/release-15.0.2", "OPLUS_CCM_SOC": "MTK", "OPLUS_CCM_COMPONENT_VERSION": "00.1.00015023.2025100915252033837650", "OPLUS_CCM_GERRIT_HOST": "http://gerrit.scm.adc.com:8080"}}}' [2025-10-09T07:39:34.021Z] % Total % Received % Xferd Average Speed Time Time Time Current [2025-10-09T07:39:34.021Z] Dload Upload Total Spent Left Speed [2025-10-09T07:39:34.021Z] 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 2625 100 21 100 2604 162 20173 --:--:-- --:--:-- --:--:-- 20343 [2025-10-09T07:39:34.021Z] [BUILD_LOG 2025-10-09 15:39:33,766 INFO] callback_ccm.py-callback_ccm: ccm callback cmd result :Internal Server Error [2025-10-09T07:39:34.021Z] callback_result:500 [2025-10-09T07:39:34.021Z] [2025-10-09T07:39:34.948Z] [BUILD_LOG 2025-10-09 15:39:34,768 INFO] callback_ccm.py-callback_ccm: ccm callback cmd is : curl -H "Content-Type:application/json" -w ' [2025-10-09T07:39:34.948Z] callback_result:%{http_code} [2025-10-09T07:39:34.948Z] ' --max-time 60 -XPOST -H "x-token:2c6ebc3e7cba9267b509defcb559803f" https://panter.myoas.com/api/v1/components -d '{"xml_absolute_path": "http://gpw14.myoas.com:80/artifactory/manifest-snapshot-local/202510/s-v-release-15.0.2/bp/MT6835_bp_202510091528f48099_user.xml", "repo_init_command": "repo init -u ssh://gerrit.scm.adc.com:29418/oplus/platform/manifest -b v/release-15.0.2 -m BP/bp_mt6835_24e_nr17r1mp5_maintain-14.1.xml --repo-branch=update --reference=/work/oppo_mirror --no-repo-verify;", "component_result": "fail", "build_parma": {"componentType": "BP", "pipeline": {"resultCallbackUrl": "http://gcode-ccm-api.myoas.com/component-service/external/callback/component/jenkins-build-result/33837650", "ccm_component_hash_fixed_callback_url": "https://gcode-ccm-api.myoas.com/single-service/jenkins/callback/component/record/hashFixed/33837650", "expireDate": "2025-11-12", "ccmBuildHistoryId": "33837650", "ccmUrl": "https://noah.myoas.com/micro-app/ccm/template/soc?id=199601&componentType=BP&indexTab=all&isFromDrawer=true&FromRecord=socDetail&vendor=MT6835&activeTab=buildRecord&recordId=33837650&componentHistoryId=33837650&FromInnerRecord=socBuildDetail", "buildTimeCallbackUrl": "http://gcode-ccm-api.myoas.com/component-service/external/callback/component/buildTime/component/33837650", "startTime": "20251009152520", "isSupportReuseVersion": "true", "jenkinEnv": "prod", "submitUsername": "V96817792", "purpose": "general"}, "patchInfo": {"baseCcmBuildHistoryId": "33458282", "patchSet": [{"type": "code", "gerritUrl": "http://gerrit.scm.adc.com:8080/#/c/40424682/1"}, {"type": "code", "gerritUrl": "http://gerrit.scm.adc.com:8080/#/c/40526967/2"}], "baseVersionAddress": "http://gpw21.myoas.com/artifactory/component-bp-snapshot-local/patch/cellPhone/Android15/MT6835/Release_Maintain/00.1.00015023/00.1.00015023-20250919233722-33458282/"}, "prop": {"OPLUS_CCM_PLATFORM": "MT6835", "OPLUS_CCM_VERSION_TYPE": "release", "OPLUS_CCM_XML_NAME": "BP/bp_mt6835_24e_nr17r1mp5_maintain-14.1.xml", "OPLUS_CCM_CFG_FILE": "bp/mt6835/bp_compile.xml", "OPLUS_CCM_DOWNLOAD_CODE_BY_GROUP": "false", "OPLUS_CCM_CFG_BRANCH": "v/release-15.0.2", "OPLUS_CCM_JFROG_URL": "http://gpw21.myoas.com/artifactory/component-bp-snapshot-local/patch/cellPhone/Android15/MT6835/Release_Maintain/00.1.00015023/00.1.00015023-20251009152520-33837650/", "OPLUS_CCM_BASE_URL": "oplus/platform/manifest", "OPLUS_CCM_LIMIT_ANDROID_API_LEVEL": "35", "OPLUS_CCM_CALCULATE_VSDK_HASH": "true", "OPLUS_CCM_BRANCH_TYPE": "Release_Maintain", "OPLUS_CCM_MANIFEST_BRANCH": "v/release-15.0.2", "OPLUS_CCM_SOC": "MTK", "OPLUS_CCM_COMPONENT_VERSION": "00.1.00015023.2025100915252033837650", "OPLUS_CCM_GERRIT_HOST": "http://gerrit.scm.adc.com:8080"}}}' [2025-10-09T07:39:34.948Z] % Total % Received % Xferd Average Speed Time Time Time Current [2025-10-09T07:39:34.948Z] Dload Upload Total Spent Left Speed [2025-10-09T07:39:34.948Z] 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 2625 100 21 100 2604 160 19851 --:--:-- --:--:-- --:--:-- 19727 100 2625 100 21 100 2604 159 19835 --:--:-- --:--:-- --:--:-- 19727 [2025-10-09T07:39:34.948Z] [BUILD_LOG 2025-10-09 15:39:34,916 INFO] callback_ccm.py-callback_ccm: ccm callback cmd result :Internal Server Error [2025-10-09T07:39:34.948Z] callback_result:500 [2025-10-09T07:39:34.948Z] [2025-10-09T07:39:34.948Z] [BUILD_LOG 2025-10-09 15:39:34,916 INFO] callback_ccm.py-tag_system_callback_ccm: ('Internal Server Error\ncallback_result:500\n',) [2025-10-09T07:39:34.948Z] [BUILD_LOG 2025-10-09 15:39:34,916 INFO] callback_ccm.py-tag_system_callback_ccm: ====== [2025-10-09T07:39:34.948Z] [BUILD_LOG 2025-10-09 15:39:34,917 INFO] callback_ccm.py-tag_system_callback_ccm: Traceback (most recent call last): [2025-10-09T07:39:34.948Z] File "/work/0004/workspace/Build_S_BP/24173/script/build_t/t_common/callback_ccm.py", line 190, in tag_system_callback_ccm [2025-10-09T07:39:34.948Z] utils.RetryRun(self.retry_count,1, callback_ccm, callback_url, callback_data, TAG_TOKEN) [2025-10-09T07:39:34.948Z] File "/work/0004/workspace/Build_S_BP/24173/script/common/utils.py", line 1048, in RetryRun [2025-10-09T07:39:34.948Z] func_result = RetryRun(try_num - 1, sleep_sec, run_func, *params) [2025-10-09T07:39:34.948Z] File "/work/0004/workspace/Build_S_BP/24173/script/common/utils.py", line 1048, in RetryRun [2025-10-09T07:39:34.948Z] func_result = RetryRun(try_num - 1, sleep_sec, run_func, *params) [2025-10-09T07:39:34.948Z] File "/work/0004/workspace/Build_S_BP/24173/script/common/utils.py", line 1048, in RetryRun [2025-10-09T07:39:34.948Z] func_result = RetryRun(try_num - 1, sleep_sec, run_func, *params) [2025-10-09T07:39:34.948Z] File "/work/0004/workspace/Build_S_BP/24173/script/common/utils.py", line 1045, in RetryRun [2025-10-09T07:39:34.948Z] raise e [2025-10-09T07:39:34.948Z] AssertionError: Internal Server Error [2025-10-09T07:39:34.948Z] callback_result:500 [2025-10-09T07:39:34.948Z] [2025-10-09T07:39:34.948Z] [2025-10-09T07:39:34.948Z] BPEnvVariable getIdentifier [2025-10-09T07:39:34.948Z] sql_cmd is : select isSupportReuseVersion from CCM_S2_0_Build_S_BP where ccmBuildHistoryId='33458282' [2025-10-09T07:39:34.948Z] [INFO]reuseBaseCcmBuildHistoryId is: None [2025-10-09T07:39:34.948Z] [tagInfo]tag_info['modemPatch'] is: {} [2025-10-09T07:39:34.949Z] self.TAGINFO = {'static_apk_url': '', 'apklistPatch': [], 'apk_absolute_path': '', 'xml_absolute_path': 'http://gpw14.myoas.com:80/artifactory/manifest-snapshot-local/202509/s-v-release-15.0.2/bp/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_jfrogpath': '', 'codePatch': [u'http://gerrit.scm.adc.com:8080/#/c/40424682/1', u'http://gerrit.scm.adc.com:8080/#/c/40526967/2'], 'compile_xml_tag': 'ab98c80f9a8d196c81d6b9f907fe676cc808629b', 'script_tag': '383e6a963f573fbcd8ef751088365f352c440a16', 'modemPatch': {}, 'xml_relative_path': 'XML_INFO/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_tag': '', 'static_apk_name': '', 'tag_type': 'ini'} [2025-10-09T07:39:34.949Z] soc is: MTK [2025-10-09T07:39:34.949Z] bp_path_name is: bp [2025-10-09T07:39:34.949Z] [INFO]remote_build_type is: False [2025-10-09T07:39:34.949Z] [ES] Successfully connected to Elasticsearch [2025-10-09T07:39:34.949Z] 回调数据: {"msg": "", "result": "fail", "area": ""} [2025-10-09T07:39:34.949Z] 回调结果: 200 [Pipeline] } [Pipeline] // stage [Pipeline] sh [2025-10-09T07:39:35.291Z] + cd /work/0004/workspace/Build_S_BP/24173/script/build_t/bp/ [2025-10-09T07:39:35.291Z] + python -O build_stage/dump_build_info.py [2025-10-09T07:39:35.547Z] [BUILD_LOG 2025-10-09 15:39:35,450 INFO] tag.py-getTagInfo: tag_info = {'static_apk_url': '', 'apk_absolute_path': '', 'xml_absolute_path': 'http://gpw14.myoas.com:80/artifactory/manifest-snapshot-local/202509/s-v-release-15.0.2/bp/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_jfrogpath': '', 'compile_xml_tag': 'ab98c80f9a8d196c81d6b9f907fe676cc808629b', 'script_tag': '383e6a963f573fbcd8ef751088365f352c440a16', 'xml_relative_path': 'XML_INFO/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_tag': '', 'static_apk_name': '', 'tag_type': 'ini'} [2025-10-09T07:39:35.547Z] [BUILD_LOG 2025-10-09 15:39:35,451 INFO] tag.py-getTagInfo: [TAGINFO] tag_info = {'static_apk_url': '', 'apklistPatch': [], 'apk_absolute_path': '', 'xml_absolute_path': 'http://gpw14.myoas.com:80/artifactory/manifest-snapshot-local/202509/s-v-release-15.0.2/bp/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_jfrogpath': '', 'codePatch': [u'http://gerrit.scm.adc.com:8080/#/c/40424682/1', u'http://gerrit.scm.adc.com:8080/#/c/40526967/2'], 'compile_xml_tag': 'ab98c80f9a8d196c81d6b9f907fe676cc808629b', 'script_tag': '383e6a963f573fbcd8ef751088365f352c440a16', 'modemPatch': {}, 'xml_relative_path': 'XML_INFO/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_tag': '', 'static_apk_name': '', 'tag_type': 'ini'} [2025-10-09T07:39:35.547Z] BPEnvVariable getIdentifier [2025-10-09T07:39:35.547Z] sql_cmd is : select isSupportReuseVersion from CCM_S2_0_Build_S_BP where ccmBuildHistoryId='33458282' [2025-10-09T07:39:35.547Z] [INFO]reuseBaseCcmBuildHistoryId is: None [2025-10-09T07:39:35.547Z] [tagInfo]tag_info['modemPatch'] is: {} [2025-10-09T07:39:35.547Z] self.TAGINFO = {'static_apk_url': '', 'apklistPatch': [], 'apk_absolute_path': '', 'xml_absolute_path': 'http://gpw14.myoas.com:80/artifactory/manifest-snapshot-local/202509/s-v-release-15.0.2/bp/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_jfrogpath': '', 'codePatch': [u'http://gerrit.scm.adc.com:8080/#/c/40424682/1', u'http://gerrit.scm.adc.com:8080/#/c/40526967/2'], 'compile_xml_tag': 'ab98c80f9a8d196c81d6b9f907fe676cc808629b', 'script_tag': '383e6a963f573fbcd8ef751088365f352c440a16', 'modemPatch': {}, 'xml_relative_path': 'XML_INFO/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_tag': '', 'static_apk_name': '', 'tag_type': 'ini'} [2025-10-09T07:39:35.547Z] soc is: MTK [2025-10-09T07:39:35.547Z] bp_path_name is: bp [2025-10-09T07:39:35.547Z] [INFO]remote_build_type is: False [2025-10-09T07:39:35.547Z] [ES] Successfully connected to Elasticsearch [2025-10-09T07:39:35.547Z] #################################################################################################### [2025-10-09T07:39:35.547Z] Start Dump Important Build Informations [2025-10-09T07:39:35.547Z] #################################################################################################### [2025-10-09T07:39:35.547Z] Build Result: :fail [2025-10-09T07:39:35.547Z] Build Failure Msg: :hudson.AbortException: script returned exit code 1 [2025-10-09T07:39:35.547Z] Jfrog URL: :http://gpw21.myoas.com/artifactory/component-bp-snapshot-local/patch/cellPhone/Android15/MT6835/Release_Maintain/00.1.00015023/00.1.00015023-20251009152520-33837650/ [2025-10-09T07:39:35.547Z] #################################################################################################### [2025-10-09T07:39:35.547Z] Finish Dump Important Build Informations [2025-10-09T07:39:35.547Z] #################################################################################################### [Pipeline] sh [2025-10-09T07:39:35.834Z] + cd /work/0004/workspace/Build_S_BP/24173/script/build_t/bp/ [2025-10-09T07:39:35.834Z] + python -O build_stage/end.py [2025-10-09T07:39:36.200Z] [BUILD_LOG 2025-10-09 15:39:35,914 INFO] tag.py-getTagInfo: tag_info = {'static_apk_url': '', 'apk_absolute_path': '', 'xml_absolute_path': 'http://gpw14.myoas.com:80/artifactory/manifest-snapshot-local/202509/s-v-release-15.0.2/bp/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_jfrogpath': '', 'compile_xml_tag': 'ab98c80f9a8d196c81d6b9f907fe676cc808629b', 'script_tag': '383e6a963f573fbcd8ef751088365f352c440a16', 'xml_relative_path': 'XML_INFO/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_tag': '', 'static_apk_name': '', 'tag_type': 'ini'} [2025-10-09T07:39:36.200Z] [BUILD_LOG 2025-10-09 15:39:35,914 INFO] tag.py-getTagInfo: [TAGINFO] tag_info = {'static_apk_url': '', 'apklistPatch': [], 'apk_absolute_path': '', 'xml_absolute_path': 'http://gpw14.myoas.com:80/artifactory/manifest-snapshot-local/202509/s-v-release-15.0.2/bp/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_jfrogpath': '', 'codePatch': [u'http://gerrit.scm.adc.com:8080/#/c/40424682/1', u'http://gerrit.scm.adc.com:8080/#/c/40526967/2'], 'compile_xml_tag': 'ab98c80f9a8d196c81d6b9f907fe676cc808629b', 'script_tag': '383e6a963f573fbcd8ef751088365f352c440a16', 'modemPatch': {}, 'xml_relative_path': 'XML_INFO/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_tag': '', 'static_apk_name': '', 'tag_type': 'ini'} [2025-10-09T07:39:44.286Z] [BUILD_LOG 2025-10-09 15:39:42,835 INFO] utils.py-CountTime: main cost time: 0m 6s [2025-10-09T07:39:44.286Z] BPEnvVariable getIdentifier [2025-10-09T07:39:44.286Z] sql_cmd is : select isSupportReuseVersion from CCM_S2_0_Build_S_BP where ccmBuildHistoryId='33458282' [2025-10-09T07:39:44.286Z] [INFO]reuseBaseCcmBuildHistoryId is: None [2025-10-09T07:39:44.286Z] [tagInfo]tag_info['modemPatch'] is: {} [2025-10-09T07:39:44.286Z] self.TAGINFO = {'static_apk_url': '', 'apklistPatch': [], 'apk_absolute_path': '', 'xml_absolute_path': 'http://gpw14.myoas.com:80/artifactory/manifest-snapshot-local/202509/s-v-release-15.0.2/bp/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_jfrogpath': '', 'codePatch': [u'http://gerrit.scm.adc.com:8080/#/c/40424682/1', u'http://gerrit.scm.adc.com:8080/#/c/40526967/2'], 'compile_xml_tag': 'ab98c80f9a8d196c81d6b9f907fe676cc808629b', 'script_tag': '383e6a963f573fbcd8ef751088365f352c440a16', 'modemPatch': {}, 'xml_relative_path': 'XML_INFO/MT6835_bp_2025091923387319e8_user.xml', 'static_apk_tag': '', 'static_apk_name': '', 'tag_type': 'ini'} [2025-10-09T07:39:44.286Z] soc is: MTK [2025-10-09T07:39:44.286Z] bp_path_name is: bp [2025-10-09T07:39:44.286Z] [INFO]remote_build_type is: False [2025-10-09T07:39:44.286Z] [ES] Successfully connected to Elasticsearch [2025-10-09T07:39:44.286Z] RM_SOURCE=1,cleaning env ... [2025-10-09T07:39:44.286Z] Traceback (most recent call last): [2025-10-09T07:39:44.286Z] File "build_stage/end.py", line 35, in <module> [2025-10-09T07:39:44.286Z] File "/work/0004/workspace/Build_S_BP/24173/script/common/utils.py", line 547, in wrapper [2025-10-09T07:39:44.286Z] File "/work/0004/workspace/Build_S_BP/24173/script/common/utils.py", line 453, in _update_end_time [2025-10-09T07:39:44.286Z] File "/usr/local/lib/python2.7/dist-packages/elasticsearch/client/utils.py", line 347, in _wrapped [2025-10-09T07:39:44.286Z] return func(*args, params=params, headers=headers, **kwargs) [2025-10-09T07:39:44.286Z] File "/usr/local/lib/python2.7/dist-packages/elasticsearch/client/__init__.py", line 1826, in search [2025-10-09T07:39:44.286Z] body=body, [2025-10-09T07:39:44.286Z] File "/usr/local/lib/python2.7/dist-packages/elasticsearch/transport.py", line 466, in perform_request [2025-10-09T07:39:44.286Z] raise e [2025-10-09T07:39:44.286Z] elasticsearch.exceptions.NotFoundError: NotFoundError(404, u'index_not_found_exception', u'no such index [chip_components_2025_10]', chip_components_2025_10, index_or_alias) [Pipeline] echo [2025-10-09T07:39:44.304Z] [Warning]: dump_build_info or clean workspace Failed , reason : hudson.AbortException: script returned exit code 1 [Pipeline] error [Pipeline] } [Pipeline] // withCredentials [Pipeline] } [Pipeline] // timeout [Pipeline] } [Pipeline] // withEnv [Pipeline] } [Pipeline] // node [Pipeline] } [Pipeline] // timestamps [Pipeline] End of Pipeline ERROR: Build Failed Finished: FAILURE
10-10
def spider(): # 发送请求 start_url = 'https://www.property.com.au/nsw/mosman-2088/alexander-ave/1-pid-27882/' headers = { 'accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7', 'accept-language': 'zh-CN,zh;q=0.9,en;q=0.8', 'cache-control': 'no-cache', 'pragma': 'no-cache', 'priority': 'u=0, i', 'upgrade-insecure-requests': '1', 'user-agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/139.0.0.0 Safari/537.36', 'cookie': 'Country=CN; pcauid=c3358816-9451-4b5d-b59f-6946dea64390; split_audience=e; _sp_ses.6d38=*; AMCVS_341225BE55BBF7E17F000101%40AdobeOrg=1; AMCV_341225BE55BBF7E17F000101%40AdobeOrg=179643557%7CMCIDTS%7C20317%7CMCMID%7C30356497971083666701109111673804723274%7CMCAAMLH-1755953785%7C11%7CMCAAMB-1755953785%7CRKhpRz8krg2tLO6pguXWp5olkAcUniQYPHaMWWgdJ3xzPWQmdj0y%7CMCOPTOUT-1755356185s%7CNONE%7CMCAID%7CNONE%7CvVersion%7C5.5.0; s_cc=true; _gcl_au=1.1.1689730178.1755348986; _ga=GA1.1.148588529.1755348987; DM_SitId1467=1; DM_SitId1467SecId12714=1; __hstc=80006152.d4550185c8de6ff8ed7c8da1e99a5e95.1755348991769.1755348991769.1755348991769.1; hubspotutk=d4550185c8de6ff8ed7c8da1e99a5e95; __hssrc=1; DM_SitId1467SecId12715=1; __hssc=80006152.18.1755348991769; utag_main=v_id:0198b2f3de8f000e82344d0600800506f001c06700978$_sn:1$_se:38$_ss:0$_st:1755352773974$ses_id:1755348983440%3Bexp-session$_pn:26%3Bexp-session$vapi_domain:property.com.au$_prevpage:pca%3Aproperty_research%3Adetails%3Aproperty_details%3Bexp-1755354577840; s_nr30=1755350977841-New; _sp_id.6d38=fd594378-8052-4e04-8d0d-08d01e852775.1755348985.1.1755350978.1755348985.c024fc26-9adb-4fa1-8c8e-2bf4ae63ba1e; _ga_FNS14GD7LR=GS2.1.s1755348986$o1$g1$t1755350977$j27$l0$h0; nol_fpid=haoli2ousngiiaoig8snkmbggvmto1755348989|1755348989878|1755350977892|1755350977957; legs_sq=%5B%5BB%5D%5D; s_sq=%5B%5BB%5D%5D; KP_UIDz-ssn=02HhamJ6P414UOBIK8rRnE8v7tWmCwo3nvtGT2sNPeuNZp2IOK27qVf7sZkyk7Q5JbQN7NQ6EN9uPu9rDifXKsMuqIaq51q5PUix15n99dUmmFuAlXLnIVR5YXssuYJvxi67rF7T204ViJbuapgM5eOjlDTKw3BRcOLuGiaZjR; KP_UIDz=02HhamJ6P414UOBIK8rRnE8v7tWmCwo3nvtGT2sNPeuNZp2IOK27qVf7sZkyk7Q5JbQN7NQ6EN9uPu9rDifXKsMuqIaq51q5PUix15n99dUmmFuAlXLnIVR5YXssuYJvxi67rF7T204ViJbuapgM5eOjlDTKw3BRcOLuGiaZjR', } response = requests.get(start_url, headers=headers).text parse_response(response) def parse_response(response): # 解析响应 - 数据清洗和过滤 A = etree.HTML(response) title_list = A.xpath('//h1[@class="Stack__StackContainer-sc-agfvon-0 fNHYjU"]/span//text()') if len(title_list) != 1: title = title_list[0] subtitle = title_list[-1] section_lists = A.xpath('//div[@class="PageContainer-sc-1bbzxlg-0 PropertyPageMainContent__PropertyPageMainBodyContentContainer-sc-44j84k-0 eTUAAl kwOMda"]/section') for section in section_lists[1: ]: key_value_lists = section.xpath('./div[@class="ContentBrick__BrickHeader-sc-1sfxg8l-1 iarlJC"]/div[@class="ContentBrick__TitlesWrapper-sc-1sfxg8l-2 kjhcFm"]//text()') if 'About the property' in key_value_lists: pass # 补充确实的key对应的value span_list = section.xpath('./div[@class="PropertyDescriptionBrickWithData__Description-sc-qqi42z-0 jRcBlF"]//text()') if span_list != []: lack_value = [''.join(span.strip()) for span in span_list] lack_value = ''.join(lack_value) ['Estimated value', 'Based on comparable sales, past sales and available property data'] ['About the property'] ['Property timeline', 'View historical data on past sold prices, rent and leased history of this house and if withdrawn from market'] 我想要在第二个列表中添加lack_value的值,该怎么实现呢?
08-17
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值