[GraphSage Code] model.py

最新推荐文章于 2022-12-12 16:42:58 发布
原创 最新推荐文章于 2022-12-12 16:42:58 发布 · 295 阅读 · 0 ·
CC 4.0 BY-SA版权
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。

博客介绍了aggregate函数，提及support_size代表每次sample每个点的总结点数，batch_size是每一批次的大小，还说明了要将层的隐藏嵌入重塑为层跳数、每个节点邻居数和特征长度的形式。

def aggregate

neigh_dims = [batch_size * support_sizes[hop], 
                              num_samples[len(num_samples) - hop - 1], 
                              dim_mult*dims[layer]]
  • support_size: 表示每一次sample的每一个点的总结点数
  • batch_size: the size of each batch

reshape the hidden embedding of hop+1 layer to:
the number of layer hop * the number of neighbours of each node * the length of feather

GraphSage-TF代码解读
图挖掘领域，新晋砖家 ☞ 未来可期，欢迎和静静一起学习交流吖
01-04 1788
转载 代码结构分析 结构 数据集 数据集 #图 #节点 #边 #特征 #标签(y) Cora 1 2708 5429 1433 7 Citeseer 1 3327 4732 3703 6 Pubmed 1 19717 44338 500 3 PPI 24 56944 818716 50 121 Reddit 1
GNN-图卷积模型-归纳式-2017：GraphSAGE【消息传递（前向传播）：聚合+更新】【聚合函数：lstm/pool】【训练更新函数参数】【不全图卷积，每次采样一批节点来卷积训练】【同质图】
u013250861的博客
08-15 1061
图神经网络(GNN)：GraphSAGE【归纳式学习框架】
Model.py文件
m0_53926478的博客
04-04 631
Model.py文件 import torch.nn as nn import torch # official pretrain weights model_urls = { 'vgg11': 'https://download.pytorch.org/models/vgg11-bbd30ac9.pth', 'vgg13': 'https://download.pytorch.org/models/vgg13-c768596a.pth', 'vgg16': 'https://do
model.py
weixin_39759634的博客
05-10 851
学习：https://zhuanlan.zhihu.com/p/29024978（我觉得蛮不错的教程，推荐给大家看） 神经网络的结构写在这个文件里model.py 本篇文章使用了DnCNN这两个版本的代码举例子 https://github.com/SaoYan/DnCNN-PyTorch/blob/master/models.py 首先，网络结构，一共有17层网络，残差学习。图...
GraphSAGE_Code解析
qq_45347768的博客
12-12 707
graphsage 源码解析
【Code】GraphSAGE 源码解析
阿泽的学习笔记
05-21 5366
1.GraphSAGE 本文代码源于 DGL 的 Example 的，感兴趣可以去 github 上面查看。 阅读代码的本意是加深对论文的理解，其次是看下大佬们实现算法的一些方式方法。当然，在阅读 GraphSAGE 代码时我也发现了之前忽视的 GraphSAGE 的细节问题和一些理解错误。比如说：之前忽视了 GraphSAGE 的四种聚合方式的具体实现，对 Alogrithm 2 的算法理解也有问题，再回头看那篇 GraphSAGE 的推文时，实在惨不忍睹= =。 进入正题，简单回顾一下 GraphSAG
【源码阅读系列】一：GraphSAGE代码阅读（1）
小小小草儿的博客哟
04-01 3942
0.前言 昨天发了一篇关于GraphSAGE论文的大致讲解，今天对源码进行部分解析，源码链接。作者最原始的训练代码是Tensorflow版本的，这是一个PyTorch版本的，恰好最近学习PyTorch，同时也有一段时间不用Tensorflow了，所以就对PyTorch版本的进行解析（其实主要是PyTorch的源码简单还少）。代码可能一次性看不完，毕竟能力有限~~，本文只放置部分关键代码。分析链接为...
dgl框架实现graphsage代码流程梳理
mydoubts的博客
04-14 4922
代码git地址：https://github.com/dmlc/dgl/blob/master/examples/pytorch/graphsage/train_sampling.py dgl在最近的4月份更新的0.4.3版本中增加了dgl.sampling.sample_neighbors的模块，用来采样邻居节点，之前的版本里面实现的graphsage没有做采样，这里记录一下实现的代码过程，对一...
GraphSage代码阅读笔记（TensorFlow版）
LIYUO94的博客
04-26 4030
一、论文、代码链接 Inductive Representation Learning on Large Graphs论文链接 graphsage代码链接 二、文件结构 1.文件目录 ├──eval_scripts //验证集 ├──example_data //ppi数据集 └──graphsage//模型结构定义、GCN层定义、…… 2.eval_scripts //验证集目录内容 ├──ci...
高光谱图像分类python代码
weixin_42402402的博客
08-28 9414
参考高光谱图像分类python代码 我建立了两个python文件： 1.data.py (负责加载.mat文件，将它转化为,csv文件） 2.train and classify.py （训练并观察分类效果） 下面分别是两段代码（对前面的引用代码做了轻微改动） 1.data.py import matplotlib.pyplot as plt import numpy as np from scipy.io import loadmat import spectral from sklearn impor
YOLO_model.py
03-31
本文件主要使用Tensorflow2.0框架搭建了YOLOV2网络模型，同时finetuning了网络初始权重，包含了网络测试代码
model.py篇
qq_43369406的博客
11-19 1482
深度学习 model.py篇
Models.py数据操作
MiniBirdie的博客
11-24 4394
Models.py数据操作   在模块编写上官方提供了教程https://docs.djangoproject.com/en/dev/topics/db/models/，但是官方教程很多地方不太详细。我们分几部分来进行讲解。   模块引用   在models.py中和模型相关的引用主要有以下两个（其他的引用主要看具体编写需求）：   from django.db import mo
每周一文（十二）GraphSage模型
更木的博客
04-13 926
契机 GCN网络两个致命的点在于： 每次都要计算邻接矩阵，如果图中的点太多，模型训练所占用的空间会很大。 新节点的加入会导致邻接矩阵的变化，这样拓展性比较差。 基于GCN上述两个问题，graphsage模型抛弃了图邻接矩阵的概念，改用聚合函数来代替邻接矩阵，且聚合函数的扩展性较强，可以完成比邻接矩阵更加复杂的操作。 模型结构 graphsage前向传播的算法如下所示： 算法最外层是K次聚合函数，这些聚合函数可以相同也可以不同，之后对于词表中每一个点，均利用改点的邻居点通过聚合函数生成该点对应的前向em
Django之model详解
weixin_30421809的博客
09-06 619
Django中的页面管理后台 Djano中自带admin后台管理模块,可以通过web页面去管理,有点想php-admin,使用步骤: 在项目中models.py 中创建数据库表 class userinfo(models.Model): nid = models.AutoField(primary_key=True) username = models.CharField(max...
model5.py-20170918
vicky428的博客
07-16 137
#!/usr/bin/env python3 # -*- coding: utf-8 -*- """ Created on Mon Sep 18 13:30:05 2017 @author: vicky """ # # 导入必要的软件包 # import argparse # import datetime # import imutils # import time # import cv...
DCGAN——菜鸟系列 model.py
qq_40240102的博客
01-09 2605
参考 [1] DGAN代码简读 https://www.colabug.com/2958322.html [2]基于DCGAN的动漫头像生成神经网络实现 https://blog.csdn.net/sinat_33741547/article/details/77871170 [3] batch norm原理及代码详解 博客： https://blog.csdn.net/qq_257...
【图神经网络】GraphSAGE
AI蜗牛车
07-27 630
作者| 追光者研究| 机器学习与时间序列出品 | AI蜗牛车一、Address发表于NIPS 2017的一篇论文地址：https://arxiv.org/pdf/1706.02216v...
INFO 07-25 07:11:43 [model_runner_v1.py:1745] Starting to load model /models/z50051264/summary/Qwen2.5-7B-nf4/... ERROR 07-25 07:11:44 [core.py:586] EngineCore failed to start. ERROR 07-25 07:11:44 [core.py:586] Traceback (most recent call last): ERROR 07-25 07:11:44 [core.py:586] File "/vllm-workspace/vllm/vllm/v1/engine/core.py", line 577, in run_engine_core ERROR 07-25 07:11:44 [core.py:586] engine_core = EngineCoreProc(*args, **kwargs) ERROR 07-25 07:11:44 [core.py:586] File "/vllm-workspace/vllm/vllm/v1/engine/core.py", line 404, in __init__ ERROR 07-25 07:11:44 [core.py:586] super().__init__(vllm_config, executor_class, log_stats, ERROR 07-25 07:11:44 [core.py:586] File "/vllm-workspace/vllm/vllm/v1/engine/core.py", line 75, in __init__ ERROR 07-25 07:11:44 [core.py:586] self.model_executor = executor_class(vllm_config) ERROR 07-25 07:11:44 [core.py:586] File "/vllm-workspace/vllm/vllm/executor/executor_base.py", line 53, in __init__ ERROR 07-25 07:11:44 [core.py:586] self._init_executor() ERROR 07-25 07:11:44 [core.py:586] File "/vllm-workspace/vllm/vllm/executor/uniproc_executor.py", line 48, in _init_executor ERROR 07-25 07:11:44 [core.py:586] self.collective_rpc("load_model") ERROR 07-25 07:11:44 [core.py:586] File "/vllm-workspace/vllm/vllm/executor/uniproc_executor.py", line 57, in collective_rpc ERROR 07-25 07:11:44 [core.py:586] answer = run_method(self.driver_worker, method, args, kwargs) ERROR 07-25 07:11:44 [core.py:586] File "/vllm-workspace/vllm/vllm/utils/__init__.py", line 2736, in run_method ERROR 07-25 07:11:44 [core.py:586] return func(*args, **kwargs) ERROR 07-25 07:11:44 [core.py:586] File "/vllm-workspace/vllm-ascend/vllm_ascend/worker/worker_v1.py", line 240, in load_model ERROR 07-25 07:11:44 [core.py:586] self.model_runner.load_model() ERROR 07-25 07:11:44 [core.py:586] File "/vllm-workspace/vllm-ascend/vllm_ascend/worker/model_runner_v1.py", line 1748, in load_model ERROR 07-25 07:11:44 [core.py:586] self.model = get_model(vllm_config=self.vllm_config) ERROR 07-25 07:11:44 [core.py:586] File "/vllm-workspace/vllm/vllm/model_executor/model_loader/__init__.py", line 59, in get_model ERROR 07-25 07:11:44 [core.py:586] return loader.load_model(vllm_config=vllm_config, ERROR 07-25 07:11:44 [core.py:586] File "/vllm-workspace/vllm/vllm/model_executor/model_loader/base_loader.py", line 38, in load_model ERROR 07-25 07:11:44 [core.py:586] model = initialize_model(vllm_config=vllm_config, ERROR 07-25 07:11:44 [core.py:586] File "/vllm-workspace/vllm/vllm/model_executor/model_loader/utils.py", line 64, in initialize_model ERROR 07-25 07:11:44 [core.py:586] return model_class(vllm_config=vllm_config, prefix=prefix) ERROR 07-25 07:11:44 [core.py:586] File "/vllm-workspace/vllm/vllm/model_executor/models/qwen2.py", line 448, in __init__ ERROR 07-25 07:11:44 [core.py:586] self.model = Qwen2Model(vllm_config=vllm_config, ERROR 07-25 07:11:44 [core.py:586] File "/vllm-workspace/vllm/vllm/compilation/decorators.py", line 152, in __init__ ERROR 07-25 07:11:44 [core.py:586] old_init(self, vllm_config=vllm_config, prefix=prefix, **kwargs) ERROR 07-25 07:11:44 [core.py:586] File "/vllm-workspace/vllm/vllm/model_executor/models/qwen2.py", line 317, in __init__ ERROR 07-25 07:11:44 [core.py:586] self.start_layer, self.end_layer, self.layers = make_layers( ERROR 07-25 07:11:44 [core.py:586] File "/vllm-workspace/vllm/vllm/model_executor/models/utils.py", line 639, in make_layers ERROR 07-25 07:11:44 [core.py:586] [PPMissingLayer() for _ in range(start_layer)] + [ ERROR 07-25 07:11:44 [core.py:586] File "/vllm-workspace/vllm/vllm/model_executor/models/utils.py", line 640, in <listcomp> ERROR 07-25 07:11:44 [core.py:586] maybe_offload_to_cpu(layer_fn(prefix=f"{prefix}.{idx}")) ERROR 07-25 07:11:44 [core.py:586] File "/vllm-workspace/vllm/vllm/model_executor/models/qwen2.py", line 319, in <lambda> ERROR 07-25 07:11:44 [core.py:586] lambda prefix: decoder_layer_type(config=config, ERROR 07-25 07:11:44 [core.py:586] File "/vllm-workspace/vllm/vllm/model_executor/models/qwen2.py", line 216, in __init__ ERROR 07-25 07:11:44 [core.py:586] self.self_attn = Qwen2Attention( ERROR 07-25 07:11:44 [core.py:586] File "/vllm-workspace/vllm/vllm/model_executor/models/qwen2.py", line 137, in __init__ ERROR 07-25 07:11:44 [core.py:586] self.qkv_proj = QKVParallelLinear( ERROR 07-25 07:11:44 [core.py:586] File "/vllm-workspace/vllm/vllm/model_executor/layers/linear.py", line 874, in __init__ ERROR 07-25 07:11:44 [core.py:586] super().__init__(input_size=input_size, ERROR 07-25 07:11:44 [core.py:586] File "/vllm-workspace/vllm/vllm/model_executor/layers/linear.py", line 420, in __init__ ERROR 07-25 07:11:44 [core.py:586] super().__init__(input_size, ERROR 07-25 07:11:44 [core.py:586] File "/vllm-workspace/vllm/vllm/model_executor/layers/linear.py", line 266, in __init__ ERROR 07-25 07:11:44 [core.py:586] self.quant_method = quant_config.get_quant_method(self, ERROR 07-25 07:11:44 [core.py:586] File "/vllm-workspace/vllm-ascend/vllm_ascend/quantization/quant_config.py", line 92, in get_quant_method ERROR 07-25 07:11:44 [core.py:586] if self.is_layer_skipped_ascend(prefix, ERROR 07-25 07:11:44 [core.py:586] File "/vllm-workspace/vllm-ascend/vllm_ascend/quantization/quant_config.py", line 126, in is_layer_skipped_ascend ERROR 07-25 07:11:44 [core.py:586] is_shard_skipped = self.quant_description[shard_prefix + ERROR 07-25 07:11:44 [core.py:586] KeyError: 'model.layers.0.self_attn.q_proj.weight' Process EngineCore_0: Traceback (most recent call last): File "/usr/local/python3.10.17/lib/python3.10/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/usr/local/python3.10.17/lib/python3.10/multiprocessing/process.py", line 108, in run self._target(*self._args, **self._kwargs) File "/vllm-workspace/vllm/vllm/v1/engine/core.py", line 590, in run_engine_core raise e File "/vllm-workspace/vllm/vllm/v1/engine/core.py", line 577, in run_engine_core engine_core = EngineCoreProc(*args, **kwargs) File "/vllm-workspace/vllm/vllm/v1/engine/core.py", line 404, in __init__ super().__init__(vllm_config, executor_class, log_stats, File "/vllm-workspace/vllm/vllm/v1/engine/core.py", line 75, in __init__ self.model_executor = executor_class(vllm_config) File "/vllm-workspace/vllm/vllm/executor/executor_base.py", line 53, in __init__ self._init_executor() File "/vllm-workspace/vllm/vllm/executor/uniproc_executor.py", line 48, in _init_executor self.collective_rpc("load_model") File "/vllm-workspace/vllm/vllm/executor/uniproc_executor.py", line 57, in collective_rpc answer = run_method(self.driver_worker, method, args, kwargs) File "/vllm-workspace/vllm/vllm/utils/__init__.py", line 2736, in run_method return func(*args, **kwargs) File "/vllm-workspace/vllm-ascend/vllm_ascend/worker/worker_v1.py", line 240, in load_model self.model_runner.load_model() File "/vllm-workspace/vllm-ascend/vllm_ascend/worker/model_runner_v1.py", line 1748, in load_model self.model = get_model(vllm_config=self.vllm_config) File "/vllm-workspace/vllm/vllm/model_executor/model_loader/__init__.py", line 59, in get_model return loader.load_model(vllm_config=vllm_config, File "/vllm-workspace/vllm/vllm/model_executor/model_loader/base_loader.py", line 38, in load_model model = initialize_model(vllm_config=vllm_config, File "/vllm-workspace/vllm/vllm/model_executor/model_loader/utils.py", line 64, in initialize_model return model_class(vllm_config=vllm_config, prefix=prefix) File "/vllm-workspace/vllm/vllm/model_executor/models/qwen2.py", line 448, in __init__ self.model = Qwen2Model(vllm_config=vllm_config, File "/vllm-workspace/vllm/vllm/compilation/decorators.py", line 152, in __init__ old_init(self, vllm_config=vllm_config, prefix=prefix, **kwargs) File "/vllm-workspace/vllm/vllm/model_executor/models/qwen2.py", line 317, in __init__ self.start_layer, self.end_layer, self.layers = make_layers( File "/vllm-workspace/vllm/vllm/model_executor/models/utils.py", line 639, in make_layers [PPMissingLayer() for _ in range(start_layer)] + [ File "/vllm-workspace/vllm/vllm/model_executor/models/utils.py", line 640, in <listcomp> maybe_offload_to_cpu(layer_fn(prefix=f"{prefix}.{idx}")) File "/vllm-workspace/vllm/vllm/model_executor/models/qwen2.py", line 319, in <lambda> lambda prefix: decoder_layer_type(config=config, File "/vllm-workspace/vllm/vllm/model_executor/models/qwen2.py", line 216, in __init__ self.self_attn = Qwen2Attention( File "/vllm-workspace/vllm/vllm/model_executor/models/qwen2.py", line 137, in __init__ self.qkv_proj = QKVParallelLinear( File "/vllm-workspace/vllm/vllm/model_executor/layers/linear.py", line 874, in __init__ super().__init__(input_size=input_size, File "/vllm-workspace/vllm/vllm/model_executor/layers/linear.py", line 420, in __init__ super().__init__(input_size, File "/vllm-workspace/vllm/vllm/model_executor/layers/linear.py", line 266, in __init__ self.quant_method = quant_config.get_quant_method(self, File "/vllm-workspace/vllm-ascend/vllm_ascend/quantization/quant_config.py", line 92, in get_quant_method if self.is_layer_skipped_ascend(prefix, File "/vllm-workspace/vllm-ascend/vllm_ascend/quantization/quant_config.py", line 126, in is_layer_skipped_ascend is_shard_skipped = self.quant_description[shard_prefix + KeyError: 'model.layers.0.self_attn.q_proj.weight' Traceback (most recent call last): File "/usr/local/python3.10.17/lib/python3.10/runpy.py", line 196, in _run_module_as_main return _run_code(code, main_globals, None, File "/usr/local/python3.10.17/lib/python3.10/runpy.py", line 86, in _run_code exec(code, run_globals) File "/vllm-workspace/vllm/vllm/entrypoints/openai/api_server.py", line 1495, in <module> uvloop.run(run_server(args)) File "/usr/local/python3.10.17/lib/python3.10/site-packages/uvloop/__init__.py", line 82, in run return loop.run_until_complete(wrapper()) File "uvloop/loop.pyx", line 1518, in uvloop.loop.Loop.run_until_complete File "/usr/local/python3.10.17/lib/python3.10/site-packages/uvloop/__init__.py", line 61, in wrapper return await main File "/vllm-workspace/vllm/vllm/entrypoints/openai/api_server.py", line 1431, in run_server await run_server_worker(listen_address, sock, args, **uvicorn_kwargs) File "/vllm-workspace/vllm/vllm/entrypoints/openai/api_server.py", line 1451, in run_server_worker async with build_async_engine_client(args, client_config) as engine_client: File "/usr/local/python3.10.17/lib/python3.10/contextlib.py", line 199, in __aenter__ return await anext(self.gen) File "/vllm-workspace/vllm/vllm/entrypoints/openai/api_server.py", line 158, in build_async_engine_client async with build_async_engine_client_from_engine_args( File "/usr/local/python3.10.17/lib/python3.10/contextlib.py", line 199, in __aenter__ return await anext(self.gen) File "/vllm-workspace/vllm/vllm/entrypoints/openai/api_server.py", line 194, in build_async_engine_client_from_engine_args async_llm = AsyncLLM.from_vllm_config( File "/vllm-workspace/vllm/vllm/v1/engine/async_llm.py", line 162, in from_vllm_config return cls( File "/vllm-workspace/vllm/vllm/v1/engine/async_llm.py", line 124, in __init__ self.engine_core = EngineCoreClient.make_async_mp_client( File "/vllm-workspace/vllm/vllm/v1/engine/core_client.py", line 96, in make_async_mp_client return AsyncMPClient(*client_args) File "/vllm-workspace/vllm/vllm/v1/engine/core_client.py", line 666, in __init__ super().__init__( File "/vllm-workspace/vllm/vllm/v1/engine/core_client.py", line 403, in __init__ with launch_core_engines(vllm_config, executor_class, File "/usr/local/python3.10.17/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/vllm-workspace/vllm/vllm/v1/engine/utils.py", line 434, in launch_core_engines wait_for_engine_startup( File "/vllm-workspace/vllm/vllm/v1/engine/utils.py", line 484, in wait_for_engine_startup raise RuntimeError("Engine core initialization failed. " RuntimeError: Engine core initialization failed. See root cause above. Failed core proc(s): {} [ERROR] 2025-07-25-07:11:52 (PID:1889, Device:-1, RankID:-1) ERR99999 UNKNOWN applicaiton exception [root@e9a74ce1729c mas]# python -m vllm.entrypoints.openai.api_server --model /models/z50051264/summary/Qwen2.5-7B-nf4/ --max-num-seqs=256 --max-model-len=4096 --max-num-batched-tokens=4096 --tensor-parallel-size=1 --block-size=128 --host=0.0.0.0 --port=8080 --gpu-memory-utilization=0.9 --trust-remote-code --served-model-name=zzz --quantization bitsandbytes --load-format bitsandbytes 我使用bitsandbytes进行nf4量化，报错如上，请分析问题原因（我启动没有量化的版本是正常的）
最新发布
07-26
| `KeyError: 'model.layers...'` | 使用显式模型类 + `trust_remote_code=True` | | 名称含 `_orig_mod` 前缀 | 权重名称重映射 | | 与 FlashAttention 冲突 | 设置 `use_flash_attention_2=False` | | 版本不兼容...
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值