Deep Learning (Article)

R0:c4c3ffc882452ee50fea21d2c6b1486a-CNN Explainer: Learning Convolutional Neural Networks with Interactive Visualization

CNN Explainer: Learning Convolutional Neural Networks with Interactive Visualization

CNN Explainer tightly integrates a model overview that summarizes a CNN’s structure, and on-demand, dynamic visual explanation views that help users understand the underlying components of CNNs. Through smooth transitions across levels of abstraction, our tool enables users to inspect the interplay between low-level mathematical operations and high-level model structures.

CNN Explainer: Learning Convolutional Neural Networks with Interactive Visualization Leer más »

R0:a8fc240769ba4448b373719f7fbe640d-Do Vision Transformers See Like Convolutional Neural Networks?

Do Vision Transformers See Like Convolutional Neural Networks?

Convolutional neural networks (CNNs) have so far been the de-facto model for visual data. Recent work has shown that (Vision) Transformer models (ViT) can achieve comparable or even superior performance on image classification tasks. This raises a central question: how are Vision Transformers solving these tasks? Are they acting like convolutional networks, or learning entirely different visual representations? Analyzing the internal representation structure of ViTs and CNNs on image classification benchmarks, we find striking differences between the two architectures, such as ViT having more uniform representations across all layers. We explore how these differences arise, finding crucial roles played by self-attention, which enables early aggregation of global information, and ViT residual connections, which strongly propagate features from lower to higher layers.

Do Vision Transformers See Like Convolutional Neural Networks? Leer más »

S++: A Fast and Deployable Secure-Computation Framework for Privacy-Preserving Neural Network Training

S++: A Fast and Deployable Secure-Computation Framework for Privacy-Preserving Neural Network Training

We introduce S++, a simple, robust, and deployable framework for training a neural network (NN) using private data from multiple sources, using secret-shared secure function evaluation. In short, consider a virtual third party to whom every data-holder sends their inputs, and which computes the neural network: in our case, this virtual third party is actually a set of servers which individually learn nothing, even with a malicious (but non-colluding) adversary.

S++: A Fast and Deployable Secure-Computation Framework for Privacy-Preserving Neural Network Training Leer más »

R0:daa46e0033d013818bcc056d269d5737-Unsupervised deep clustering and reinforcement learning can accurately segment MRI brain tumors with very small training sets

Unsupervised deep clustering and reinforcement learning can accurately segment MRI brain tumors with very small training sets

«We have demonstrated a proof-of-principle application of unsupervised deep clustering and reinforcement learning to segment brain tumors. The approach represents human-allied AI that requires minimal input from the radiologist without the need for hand-traced annotation».

Unsupervised deep clustering and reinforcement learning can accurately segment MRI brain tumors with very small training sets Leer más »

R0identifier_ 7029b309b114bdb1aa72b6fd0da905f3-Yann LeCun’s Deep Learning Course at CDS

Yann LeCun’s Deep Learning Course at CDS

This course concerns the latest techniques in deep learning and representation learning, focusing on supervised and unsupervised deep learning, embedding methods, metric learning, convolutional and recurrent nets, with applications to computer vision, natural language understanding, and speech recognition. The prerequisites include: DS-GA 1001 Intro to Data Science or a graduate-level machine learning course.

Yann LeCun’s Deep Learning Course at CDS Leer más »

Medical Open Network for AI (MONAI), AI Toolkit for Healthcare Imaging

Medical Open Network for AI (MONAI), AI Toolkit for Healthcare Imaging

The MONAI framework is the open-source foundation being created by Project MONAI. MONAI is a freely available, community-supported, PyTorch-based framework for deep learning in healthcare imaging. It provides domain-optimized foundational capabilities for developing healthcare imaging training workflows in a native PyTorch paradigm.

Medical Open Network for AI (MONAI), AI Toolkit for Healthcare Imaging Leer más »

Introduction to CNTK Succinctly (Microsoft Cognitive Toolkit)

Introduction to CNTK Succinctly (Microsoft Cognitive Toolkit)

«Microsoft CNTK (Cognitive Toolkit, formerly Computational Network Toolkit), an open source code framework, enables you to create feed-forward neural network time series prediction systems, convolutional neural network image classifiers, and other deep learning systems. In Introduction to CNTK Succinctly, author James McCaffrey offers instruction on the basics of installing and running CNTK, and also addresses machine-learning regression and classification techniques. Exercises and explanations are included in each chapter». (Syncfusion)

Introduction to CNTK Succinctly (Microsoft Cognitive Toolkit) Leer más »