Deep Learning, Wireless Communications, and Signal Processing: Bridging the Gap
What this presentation is about and why it matters
This talk explores how modern deep learning methods can be applied to problems in wireless communications and classical signal processing — and how the three areas feed each other. The speaker shows concrete examples: transforming multivariate time‑series wireless measurements (Channel State Information, CSI) into image-like representations, then using image-based deep networks for human activity recognition; and drawing connections between optimization techniques used in DSP/wireless (like LMS adaptive filters) and stochastic gradient methods used in deep learning.
Why it matters: engineers working on radios, sensors, and embedded signal chains increasingly face complex, data‑driven problems where classical analytical methods alone are insufficient. Being able to convert time‑series to representations that leverage powerful computer‑vision models, and understanding the shared math behind adaptive filters and SGD, gives practical tools for higher accuracy, faster prototyping, and better system-level performance — while also highlighting the pressing need for interpretability in safety‑critical systems.
Who will benefit the most from this presentation
- Signal processing engineers curious about machine learning applications to time‑series data from radios and sensors.
- Wireless communications researchers and practitioners exploring sensing from Wi‑Fi or other RF signals.
- Machine learning engineers who want practical ways to apply vision models to non‑image signals.
- Graduate students learning the connections between optimization algorithms in DSP and modern deep learning.
- Product engineers who need intuition about explainability when deploying ML in communication systems.
What you need to know
Background that will make the talk easier to follow:
- Time‑series basics: sampling, multivariate sequences, stationarity vs non‑stationarity, common noise behaviors in wireless channels.
- Channel State Information (CSI): CSI captures amplitude and phase per subcarrier/antenna and is sensitive to moving reflectors (people). Intuitively, activity alters multipath and can be sensed via CSI variations.
- Signal ↔ Image transforms: The talk uses transforms that map a 1‑D time‑series into a 2‑D matrix so that image models can be applied. Two examples are Markov Transition Fields (MTF) and Gramian Angular Fields (GAF/GASF/GADF).
- Convolutional neural networks (CNNs): these exploit local spatial patterns in images. When a time series is transformed into an image, CNNs can learn patterns that represent temporal dynamics or correlations.
- Optimization and gradients: be comfortable with the gradient‑descent update rule: $x_{\text{new}} = x_{\text{old}} - \alpha \nabla f(x_{\text{old}})$, where $\alpha$ is the learning rate. In machine learning the empirical loss often has the finite‑sum form $L(w)=\frac{1}{n}\sum_{i=1}^n l_i(w)$ and SGD approximates its gradient using mini‑batches.
- LMS vs SGD: Least Mean Squares (LMS) is the classical adaptive filter update for minimizing mean squared error; it is mathematically a specific instance of stochastic gradient descent tailored to quadratic losses.
- Explainable AI basics: techniques like Grad‑CAM produce heatmaps that highlight which parts of an input drove a network’s decision. Complement this with classic signal visualizations (spectrograms, histograms) to build interpretability.
- Practical tooling: familiarity with Python, numpy, matplotlib, and higher‑level packages like pyts (for time‑series imaging), and a deep‑learning framework such as TensorFlow/Keras or PyTorch will help you reproduce examples.
- Computational concerns: converting long CSI sequences to images can be memory‑intensive; tuning learning rates, mini‑batch sizes and regularization remain important to avoid unstable training.
Glossary (terms used in this talk)
- Convolutional Neural Network (CNN): A neural network architecture that uses convolutional layers to learn local patterns, widely used for image-like data representations.
- Deep learning: A class of machine learning methods that use neural networks with many layers to learn hierarchical representations from data.
- Signal processing: Methods for analyzing, filtering, transforming, and interpreting signals such as time-series or frequency-domain data.
- Wireless communications: The transmission and reception of information over radio-frequency channels, including the physical-layer behavior of the propagation environment.
- Channel State Information (CSI): Measurements that characterize a wireless channel, typically including amplitude and phase across subcarriers or antennas.
- Markov Transition Field (MTF): A time-series imaging method that encodes transition probabilities between quantized states as a matrix representation.
- Gramian Angular Field (GAF): A time-series imaging method that converts a sequence into a matrix using angular encoding to preserve pairwise temporal relationships.
- Gramian Angular Summation Field (GASF): A Gramian Angular Field variant that forms a matrix from the sum of angular encodings of time-series samples.
Toolbox (mentioned in this talk)
- NumPy: A foundational Python library for array computing and numerical operations.
- Matplotlib: A Python plotting library used for creating static, animated, and interactive visualizations.
- pyts: A Python library for time-series classification and transformation, including time-series imaging methods.
- TensorFlow: An open-source machine learning framework for building and training neural networks and other numerical models.
- Keras: A high-level deep-learning API used to build and train neural networks, commonly associated with TensorFlow.
- PyTorch: An open-source machine learning framework for tensor computation and deep neural network training.
Final thoughts
This overview is AI-generated from the session transcript. Spot an issue? Let us know.
What is the primary reason the speaker recommends converting Wi‑Fi CSI time‑series into images (e.g., MTF or GAF) before applying deep learning?
The source code can now be downloaded in the column on the left-hand side
The approach of converting RF field complexity with (SGAF, DGAF, MTF tools) to an image and then using SGD, DL tools developed for image analysis, is an interesting take. Your comments regarding XAI are duly noted.
Dear Dheeraj, thank you for your interesting talk using a practical application of Markov fields and DL. I enjoyed it very much. Do you offer the source code you showed in your presentation somewhere (GitHub)? I would be very interested to evaluate your steps on my own. Thank you
/Thomas