[综述笔记]Deep learning for brain disorder diagnosis based on fMRI images-优快云博客

本文链接：https://blog.youkuaiyun.com/Sherlily/article/details/143344553

论文网址：Deep learning for brain disorder diagnosis based on fMRI images - ScienceDirect

英文是纯手打的！论文原文的summarizing and paraphrasing。可能会出现难以避免的拼写错误和语法错误，若有发现欢迎评论指正！文章偏向于笔记，谨慎食用

2.3. The overview of deep learning methods

2.3.1. Artificial intelligence, machine learning and deep learning

2.3.2. Brief introduction to deep learning techniques in fMRI analysis

2.4. Deep learning in brain disorder diagnosis

2.4.1. Functional connectivity model based approaches

2.4.2. 2D/3D image processing perspective

2.4.3. fMRI images as a time series

2.4.4. Joint spatial and temporal feature exploration

2.4.5. Other deep learning models and training techniques

2.4.6. Summary

2.5. Challenges and future outlook

2.5.1. Discussions

2.5.2. Future outlook

3. Reference

1. 心得

（1）少儿科普是吧？不推荐已经很熟悉这个领域的人看

（2）我怎么才刚开始就要看不下去了

（3）仅用图表示最基础的结构（如CNN或AE），但用过量的文字讲述一万个模型，是一种，让人，极为没有耐心的写作方式

（4）有一种站在未来看过去的感觉...但是吧...有些过去不是非要看的...

2. 论文逐段精读

2.1. Abstract

①fMRI can be regarded as image, time series and image series

2.2. Introduction

①Introducing fMRI itself→applications→pros and cons→compared with other imaging methods→introducing ML and AI

2.3. The overview of deep learning methods

2.3.1. Artificial intelligence, machine learning and deep learning

（1）Artificial intelligence

①介绍了...AI...

②The relationship between AI, ML and DL:

（2）Machine learning

①Categories of ML: supervised learning, unsupervised Learning, semi-supervised learning and reinforcement learning

（3）Deep learning

①...有出色的性能？？受益于计算能力？？fine

2.3.2. Brief introduction to deep learning techniques in fMRI analysis

①Common use DNN: CNN and RNN

②Workflow of deep learning:

（1）Convolutional neural networks

①介绍CNN？？？？卷积？？！激活函数？？

②图像分类的简化CNN网络？？？图？和上一张图有什么不一样？？

（2）Recurrent neural network

①Famous RNN: LSTM and GRU

（3）Auto encoder and decoder

①An example AE:

2.4. Deep learning in brain disorder diagnosis

2.4.1. Functional connectivity model based approaches

（1）Functional connectivity model construction

①Static and dynamic FC construction methods:

（2）FC based DL methods

①ML pipeline:

（3）Direct use of functional connectivity measures

①Directly classify FC matrix

②疯狂地用文字介绍了一堆方法

（4）End-to-end model for disease classification

①继续介绍一堆模型

（5）Connectivity matrices as an analogy to 2D images

①...Some researchers consider fMRI as 2D images and Conv it

（6）Comment on functional connectivity based methods

①There are some noises in raw fMRI data

2.4.2. 2D/3D image processing perspective

（1）4D fMRI to 2D images conversion

①列举了一堆4D转2D然后卷积的办法，从引用就能看出这些办法其实很老了，全在2020之前，而且这本来就有那么点不合理（虽然这篇是22写的啦...所以其实对于现在的我们参考性不是很强）

（2）3D neural network

①扒拉了一堆模型

（3）Challenges and opportunities

①For limited samples, the prior kownledge is feasible

2.4.3. fMRI images as a time series

①继续列

2.4.4. Joint spatial and temporal feature exploration

①Lists models with spatial and temporal methods

2.4.5. Other deep learning models and training techniques

（1）Graph CNN and its applications

（2）Generative models

（3）Transfer learning

2.4.6. Summary

①作者觉得以后深度学习会在临床诊断中大放异彩

2.5. Challenges and future outlook

2.5.1. Discussions

①Non of a DL model can contain all the tasks of disease diagnosis（确实，作者当时写的时候大模型还没有风靡，可能确实觉得，一个模型很难顾及到所有方面）

②Challenges: a) costs, b) interpretability

2.5.2. Future outlook

①“尽管近年来使用 fMRI 图像在脑部疾病诊断方面取得了巨大成功，但距离临床诊断要求还很远”，没错其实...2024年仍然还有一些距离，还需要一点重大突破...

②Researchers should mix all the data together, including electronic medical record, EEG, structural MRI image etc...确实，现在多模态还发展得不错

3. Reference

Yin, W., Li, L., & Wu, F. (2022) 'Deep learning for brain disorder diagnosis based on fMRI images', Neurocomputing, 469: 332-345. doi: https://doi.org/10.1016/j.neucom.2020.05.113