Combining a device that could incorporate aspects of EEG, fMRI, and PET would be very optimal in practice, as the strengths in one imaging modality could compensate for the weaknesses in another imaging modality. At the moment, there is no single brain imaging technique that captures electric, hemodynamic, and metabolic functions of the brain at the same time. However, with recent developments in neuroimaging technology, there have been novel approaches to exploring all three aspects at the same time by integrating simultaneous EEG-fMRI’s with fPET-FDG in real world practice (Chen et al., 2025).
Kiara Ruda Neuroimaging Portfolio
Introduction
Unique Contributions of Each Modality
Each modality is unique in how it contributes to representing the brain’s function, with the combination of all three modalities allowing for a more comprehensive and multidimensional analysis of neural activity. Electroencelography (EEG) provides millisecond-level resolution of the electrical activity in the brain through recording the summed postsynaptic potentials of many cortical pyramidal neurons. The spatial precision of EEG is limited, though, due to signals being distorted by biological and environmental artifacts as they pass through the skull (Britton et al., 2016). Functional magnetic resonance imaging (fMRI) provides high resolution spatial maps of brain activity through the detection of changes in blood flow. When neurons in the brain fire, more oxygen is consumed. This hemodynamic response causes regional changes in the BOLD signal that the fMRI scan visualizes. Unfortunately, a drawback of fMRI is its limited temporal resolution, as it is much slower than EEG at capturing events, typically capturing events in seconds rather than milliseconds (Cleveland Clinic, 2023). Positron emission tomography (PET) reveals metabolic and biochemical function. This scan does this by injecting a radioactive tracer, which gets accumulated in specific tissues in the brain based on activity, allowing for imaging of brain regions and organs based on the uptake of the tracer. A limitation of PET is the long timescale that it takes for tracer distribution, which is typically minutes. A second limitation of PET is its major reliance on radiation, which may restrict repeated use of this form of imaging. (Mayo Clinic, 2025).
Hybrid System Benefits
Creating a hybrid system with all 3 of these imaging techniques would complement each other significantly, as each technique captures information about the brain that other techniques cannot capture. EEG contributes to the temporal resolution through its millisecond-level information about the neural timing of events, which neither fMRI or PET can do. fMRI provides high resolution spatial maps of where these specific events occur, which EEG cannot precisely localize. PET contributes metabolic and biochemical information, showing how active certain brain regions are, which cannot be quantified through EEG or fMRI. Their temporal and spatial characteristics naturally complement one another: EEG captures rapid electrical changes, fMRI links those changes to specific anatomical regions, and PET explains the underlying metabolic demands. Each technique offsets the limitations of the others. EEG’s poor spatial resolution is strengthened by fMRI’s detailed localization. fMRI’s slow temporal resolution is compensated by EEG’s fast timing. PET fills the mechanistic gap by identifying metabolic activity that electrical and hemodynamic signals cannot.
Technical Integration
EEG, fMRI, and PET can all be used in the same session by using a PET-MRI scanner. These scanners are built so PET detectors can work safely inside the MRI’s strong magnetic field, using non-magnetic parts and shielding to keep the PET and MRI systems from interfering with each other (Vitor et al., 2017). Recent case studies have also shown that EEG can be paired with PET, with researchers aligning 64-channel EEG signals to PET metabolic data to evaluate treatment responses in Alzheimer’s disease (Wang et al., 2025). Adding EEG to a PET-MRI setup is feasible when an MRI-compatible EEG cap is used. EEG can be recorded inside an MRI, but the scanner’s magnetic fields and rapid gradient switching create strong electrical noise in the EEG wires. This interference is minimized by using non-metallic electrodes, arranging cables to avoid loops that pick up magnetic noise, and applying software filters afterward to clean out MRI-related artifacts.
Data Synchronization
All three techniques can collect data at the same time, but they run on very different time scales. EEG measures activity in milliseconds, fMRI takes whole-brain images in seconds, and PET tracks tracer uptake over minutes. To synchronize them, the MRI scanner sends timing pulses to the EEG system so every EEG sample is linked to the exact moment each MRI image is taken. PET data are grouped into time windows that match longer periods of EEG and fMRI activity, which makes it possible to compare fast electrical changes with the slower blood-flow and metabolic signals. This approach allows quick EEG events to be aligned with delayed fMRI BOLD responses and with the even slower PET metabolic changes, so all three modalities can be interpreted within the same timeline.
Spatial Alignment
To combine all three techniques in the same space, all data are aligned to the structural MRI scan that is collected as part of the fMRI session. This acts as the reference frame for spatial coordinates. The positions of the EEG electrodes on the scalp are digitized and mapped onto this MRI head shape so the electrical activity can be linked to specific brain regions. PET images, which are acquired simultaneously in a PET-MRI scanner, are automatically aligned with the MRI as well. Because EEG has poor spatial resolution, fMRI provides detailed spatial maps, and PET has moderate resolution, the signals are combined by matching all three datasets to the MRI anatomy. This allows electrical activity, blood-flow changes measured by fMRI, and metabolic signals from PET to be displayed together on one consistent brain map.
Applications and Challenges
When all three techniques are combined together, a researcher would see signals layered onto the same brain map. The fMRI data would show detailed regions of the brain that change with blood flow, PET would show slower metabolic changes in those same regions, and EEG activity would appear as time-varied signals linked to those spots on the cortex. On the screen, it would look like rapid EEG spikes occurring in a location that the fMRI highlights as active, while the PET map shows whether that region is using more energy than normal. This fusion creates new features that none of the techniques can show on their own. For example, you can measure how much metabolic demand is associated with specific electrical events, or how strongly an EEG pattern predicts a later fMRI or PET change. You can also track the full chain of activity, such as fast electrical firing, followed by blood-flow increases, followed by slow metabolic demand. That “chain” is the added value. If a researcher sees a spike of EEG activity in the temporal lobe at the same time that the fMRI shows increased BOLD signal in that region, and PET shows higher glucose use there, they can conclude that the area is not only firing but also recruiting blood flow and consuming extra energy to support the activity. This kind of multi-layer finding cannot be identified using any individual imaging technique by itself.
Challenges
A challenge comes from combining EEG with MRI at higher magnetic field strengths, since stronger fields create larger EEG artifacts, greater heating risks, and more distortion in both EEG and fMRI signals, making simultaneous recordings harder to manage (Neuner et al., 2014). Another challenge comes from fMRI being costly and not readily available, which is an issue for PET scanners as well. The environment that individuals are placed in when using an fMRI is very confined, which may trigger claustrophobia, as well as induce brain responses to the noise that is emitted when obtaining these scans (Crosson et al., 2011).
Potential Benefits
This hybrid system would be beneficial to epileptic patients when experiencing seizures, as it can show the exact timing of a seizure with EEG, the location of the seizure with fMRI, and the long-term metabolic problems in that area with PET. For patients with early stages of Alzheimer's disease development, this system would be helpful as EEG can show slowed brain activity, fMRI can show weaker brain networks, and PET can detect early metabolic changes, making it easier to catch the disease sooner.
References
- Britton, J. W., Frey, L. C., Hopp, J. L., St. Louis, E. K., & Frey, L. C. (Eds.). (2016). Electroencephalography (EEG): An introductory text and atlas of normal and abnormal findings in adults, children, and infants. American Epilepsy Society. https://www.ncbi.nlm.nih.gov/books/NBK390346/
- Chen, J. E., Lewis, L. D., Coursey, S. E., Catana, C., Polimeni, J. R., Fan, J., Droppa, K. S., Patel, R., Wey, H.-Y., Chang, C., Manoach, D. S., Price, J. C., Sander, C. Y., & Rosen, B. R. (2025). Simultaneous EEG-PET-MRI identifies temporally coupled, spatially structured hemodynamic and metabolic dynamics across wakefulness and NREM sleep. bioRxiv. https://doi.org/10.1101/2025.01.17.633689
- Cleveland Clinic. (2023). Functional MRI (fMRI). https://my.clevelandclinic.org/health/diagnostics/25034-functional-mri-fmri
- Crosson, B., Benefield, H., Moore, A. B., Wierenga, C. E., Gopinath, K., Soltysik, D., Briggs, R. W. (2011). Functional MRI of language: Clinical applications. Journal of Rehabilitation Research and Development, 48 (4), 315–332. https://doi.org/10.1682/jrrd.2010.02.0017
- Mayo Clinic. (2025). PET scan. https://www.mayoclinic.org/tests-procedures/pet-scan/about/pac-20385078
- Neuner, I., Arrubla, J., Felder, J., & Shah, N. J. (2014). Simultaneous EEG-fMRI acquisition at low, high and ultra-high magnetic fields up to 9.4 T: Perspectives and challenges. NeuroImage, 102 (Part 1), 49–54. https://doi.org/10.1016/j.neuroimage.2013.06.048
- Vitor, T., Martins, K. M., Ionescu, T. M., Cunha, M. L., Baroni, R. H., Garcia, M. R. T., Wagner, J., Campos Neto, G. C., Nogueira, S. A., Guerra, E. G., & Amaro Jr., E. (2017). PET/MRI: A novel hybrid imaging technique — major clinical indications and preliminary experience in Brazil. Einstein (São Paulo), 15 (1), 115-118. https://www.scielo.br/j/eins/a/QC7q4X5jLjGVHzg65PbNMmR/
- Wang, Y., et al. (2025). Evaluation of treatment response using simultaneous EEG–PET in Alzheimer’s disease. Therapeutic Advances in Neurological Disorders. https://doi.org/10.1177/25424823251395615
Other Course Work
📊 Assignment 1: EEG Analysis
📄 PSYCH 403 Assignment 1 - Kiara Ruda 1754188 (1) - Kiara Ruda.pdf
View Original PDF- The raw EEG data shows all of the activity recorded from each of the 8 electrodes. Since this data is unfiltered, muscle artifacts, environmental noise, and eye movements can also be visualized, as each of these creates electrical activity. Each coloured line represents a different electrode and the corresponding activity that it measures.
- The filtered EEG data shows us the same segment of the brain wave data, but with a narrow band-pass filter applied. The frequency is limited to 8-12Hz, showing us the alpha waves, which is why the brain wave data is smoother. All brain waves that fall out of this 8-12Hz range are not shown in the plot.
- Top: Raw EEG Data Power Spectrum → the frequency breakdown of the raw brain wave data is shown. All of the brain activity and noise is visualized, which is why there is no prominent peak across the frequencies.
- Bottom: Alpha Filtered EEG Data Power Spectrum → the frequency breakdown of the filtered brain wave data is shown. There is a prominent peak at approximately 8-12Hz because this frequency corresponds to alpha waves. Activity from all other frequencies are filtered out and reduced.
🎨 Assignment 2: BrainImation
📄 PSYCH 403 Assignment 2 - Kiara Ruda.pdf
View Original PDFI chose to modify the Brain Particles template in order to create a new brain art visualization. In
my new version, the particles now respond to alpha and beta brain wave activity.
Regarding the movement of the brain particles, I adjusted the speed so that when the alpha
waves are higher (relaxed or meditating brain state), the particles will speed up. When the alpha
waves are lower (not relaxed or meditating), the brain particles slow down. The direction that the
particles move in are also modified, so that most particles move in a negative direction rather
than in random directions. When beta waves are high (the individual is allocating attention
towards a stimulus), the shape of the particles somewhat changes, becoming more circular,
while moving in a less smooth and more pulsing fashion. I also adjusted the colour of the brain
particles; when the alpha waves are lower, the hue is purple. When the alpha waves are higher,
the hue turns green. Lastly, I made the particles more dim compared to the brightness that the
template had initially started with.
A difficulty I had with this project was figuring out the purpose of each line in the code. Without
comments embedded in the code, such as “// Movement influenced by brain waves”, it would
have been extremely challenging to modify aspects of visualization.
Something I learned from all of this was that you can do almost anything you want with brain art
by just making a few changes to a pre-existing code. I’m not very well-versed in coding, but this
assignment was very interesting due to the challenges presented, as well as the new skills and
knowledge gained from this experience.
// Brain particle system
let particles = [];
function setup() {
colorMode( HSB , 250 , 10 , 100 );
for ( let i = 0 ; i < 100 ; i++) {
particles.push({
x: random(width),
y: random(height),
vx: random(- 9 , - 10 ),
vy: random(- 9 , - 10 ),
life: 1.0
});
}
}
function draw() {
background( 0 , 0 , 0 , 0.1 );
for ( let p of particles) {
// Movement influenced by brain waves
p.vx += (random(- 1 , 1 ) * eegData.alpha * 0.1 );
p.vy += (random(- 1 , 1 ) * eegData.beta * 0.1 );
p.x += p.vx * ( 1 + eegData.alpha);
p.y += p.vy * ( 1 + eegData.alpha);
// Wrap around
if (p.x < 0 ) p.x = width;
if (p.x > width) p.x = 0 ;
if (p.y < 0 ) p.y = height;
if (p.y > height) p.y = 0 ;
// Draw particle
let hue;
if (eegData.alpha > 0.7 ) {
hue = 60
} else {
hue = map(eegData.theta, 0 , 1 , 180 , 300 )
}
fill(hue, 80 , 90 , p.life);
noStroke();
ellipse(p.x, p.y, 5 + eegData.gamma * 35 );
p.life *= 0.995 ;
if (p.life < 0.1 ) p.life = 1.0 ;
}
}
🎥 IMG_6333 - Kiara Ruda.mov
💡 Videos require Google Drive access. Open in new tab if it doesn't load.
🎯 Midterm Project
📄 PSYCH 403 Midterm 1 - Kiara Ruda - Kiara Ruda.pdf
View Original PDFPart 1:
I implemented an Adaptive Difficulty System as my novel BCI component to my pre-existing
code, which reacts to the level of stress from the individual. If the individual is stressed, with
beta waves being higher than alpha waves, the difficulty of the task, or the particle moving
across the screen, decreases. The particles in the background turn red, moving faster and
erratically with a pulsing ring in the centre, reflecting the individual's internal state. If the
individual is calm, with alpha waves being higher than beta waves, the difficulty of the task
increases. The particles in the background turn green, moving slower and less erratic than they
would have if the individual had allocated more attention to the task.
For the loop, the input comes from simulated EEG signals from alpha, beta, delta, and theta
waves. Beta and alpha waves are compared to each other, and when beta is greater than alpha,
it indicates that the individual is stressed, allocating an increased amount of attention to the
task. This translates to the difficulty of the task being represented as a number closer to 0 on a
0-1 scale. The opposite outcome (alpha waves being greater than beta) translates to less
attention, with the numeric representation being closer to 1.
This is different from a basic control of the parameters because it implements a combination of
brain states, which are stress vs calm, which interact with the two given parameters on the
Brainimation website, attention and meditation.
I learned how attention and meditation can interact with each other in complex ways, and how
this can be depicted interestingly in a visualization that responds to real time and simulated
EEG data. I also learned how to have patience through difficult situations, as my code would not
work properly for hours through the creation process.
Part 2:
I chose to measure the P300, which peaks when unexpected events or stimuli are presented.
Since attention is at the basis of this cognitive process, the temporal and parietal regions of the
brain will show the most activity. For my ERP experiment, the temporoparietal regions of the
brain, which can be represented as TP9 and TP10 channels, are greatly involved in this
cognitive process. EEG data from the anterior frontal regions of the brain are also collected,
which are represented as AF7 and AF8 channels.
I utilized an oddball task, meaning that 80% of the time a common or expected stimulus is
presented to the individual. The common stimulus that I chose to use in this scenario was a blue
smiley face. For the other 20% of the time, a rare or unexpected stimulus is presented to the
individual, which is intended to peak their attention, therefore eliciting a P300 response in the
parietal regions of the brain. The rare stimulus that I chose to use in this scenario was a red
angry face. Each trial begins with a baseline period of 200ms, followed by a stimulus
presentation for 100ms, and then a 800ms window to record the elicited brain responses.
The averaging system I implemented records data from the most recent 20 trials, with the data
that is visualized on the screen being represented as the rolling average of these 20 trials.
According to the literature, I would expect that the P300 would peak at 300-600ms when the
individual is presented with the unexpected stimulus, the angry face, which reflects the brain’s
orienting response to significant events.
🎥 PSYCH 403 MT 1 PT 2 - 2025-10-26 193545 - Kiara Ruda.mp4
💡 Videos require Google Drive access. Open in new tab if it doesn't load.
🎥 PSYCH 403 MT 1 PT 1 - 2025-10-26 193130 - Kiara Ruda.mp4
💡 Videos require Google Drive access. Open in new tab if it doesn't load.
📝 ruda_midterm_part2 - Kiara Ruda.txt
💡 Code is embedded in this portfolio - opens instantly in the live BrainImation editor (no internet required!)
📝 ruda_midterm_part1 - Kiara Ruda.txt
💡 Code is embedded in this portfolio - opens instantly in the live BrainImation editor (no internet required!)