2017-04-13 16:36:31

Go with the flow: Babies, brains, behavior & open science

Rick O. Gilmore

Support: NSF BCS-1147440, NSF BCS-1238599, NICHD U01-HD-076595

Goals

  • A bit about me
  • A bit about my research
  • Sharing the goodness: Let's make science open

A bit about me

Background

  • Associate Professor of Psychology
  • Founding Director of Human Imaging at Penn State's SLEIC
  • Co-founder and Co-Director of the Databrary.org digital library
  • A.B., Cognitive Science, Brown; M.S. & Ph.D., Psychology, Carnegie Mellon University
  • Folk music, theatre, poetry, cycling, hiking, paddling, hiking/backpacking, amateur radio (K3ROG)

A bit about my research

Questions

  • What is optic flow?
  • Why is optic flow important?
  • How does optic flow sensitivity develop?
  • How do brain systems for processing optic flow develop?
  • What shapes these patterns of development?

Approach

  • EEG measures of brain responses to optic flow
  • Psychophysical (behavioral) measures of optic flow perception
  • Empirical measures of experienced optic flow across development from head-mounted video cameras

What is Optic Flow?

  • Structured pattern of visual motion generated by observer movement

Types of Optic Flow

(Yu et al. 2010)

Why is optic flow important?

  • Geometry of environment
    • Surface layout, orientation
    • Object motion
  • Direction, speed of self-motion
    • Rotation, translation
    • Visual proprioception (eye vs. head vs. body)

Flow and self-motion

How Does Optic Flow Sensitivity Develop?

(R. Gilmore et al. 2007)

4-6 mo-old infants: Larger brain responses to linear patterns.

(Hou et al. 2009)

4-6 mo-old infants: Larger brain responses to faster speeds.

(Kiorpes and Movshon 2004)

Sensitivity to slow (linear) speeds develops slowly in monkeys.

Brain responses to flow

Methods

  • Time-varying optic flow patterns.
  • Steady-state visual evoked potentials (SSVEPs).
    • Event-related electro-encephalogram (EEG) technique.
    • Phase-locked responses at low-order harmonics.
  • n=29 4-8 year-olds.
  • (R. Gilmore, Thomas, and Fesi 2016)

2 deg/s translation

4 deg/s rotation

8 deg/s radial

1F1 Channel-Wise Results

1F1 Channels p < .0005

Complex Domain Plot of 1F1 Channels

1F1 Results Summary

  • Highly responsive channels over right lateral cortex
  • Radial & rotation >> translation
  • Amplitude and phase differences

3F1 Channel-Wise Results

3F1 Channels p < .0005

Complex Domain Plot of 3F1 Channels

3F1 Results Summary

  • Highly responsive channels over medial cortex
  • Speed, but not pattern tuned, 2 < 4 = 8 deg/s
  • Amplitude and phase differences

Results Summary

  • Anatomical separation of responses
    • speed (medial)
    • vs. pattern (lateral)
  • Radial & rotation != translation
  • Speed tuning

Children's 1F1

Adults' 1F1

Children's 3F1

Adults' 3F1

Behavioral responses to flow

Methods

  • Time-varying optic flow
    • Radial, linear
    • {2 deg/s, 8 deg/s}
    • {5, 10, 15, 20%} coherence (adults)
    • {15, 30, 45, 60%} and {20, 40, 60, 80%} (children)

Methods

Children's responses p(correct)

Adults' responses p(correct)

Speed effects in children

Speed effects in adults

Pattern effects in children

Pattern effects in adults

Behavioral Summary

  • Children's behavior: more accurate to detect fast speeds, radial patterns
  • Adults more accurate to detect slow speeds, radial patterns
  • Response speeds in children and adults (not shown) show similar patterns
  • But, why?

Measuring the statistics of visual experiences

Potential factors shaping development of flow sensitivity

  • External
    • Environment
  • Internal
    • Posture
    • Locomotion, head, eye movements

Head mounted eye tracker data from "coupled" infant/mom dyads

Adolph, K. (2015). Active vision in passive locomotion: real-world free viewing in infants and adults. Databrary. Retrieved February 18, 2017 from http://doi.org/10.17910/B7.123

Mothers

Findings

Findings

  • Infant (passengers) experience faster visual speeds than mother
  • Controlling for speed of locomotion, environment

Experienced flow across cultures

Illustrative Speed Histograms - 6 weeks

Illustrative Speed Histograms – 34 weeks

Illustrative Speed Histograms – 58 weeks

Pattern Correlation Results

Conclusions: Measuring experienced flow

  • Fast speeds, broad speed distributions
  • Linear flow >> radial or rotational flow

Summing up

  • Infants commonly experience fast, linear optic flows
  • Brain and behavioral responses to optic flow develop throughout childhood
    • Still immature in 5-8 year-olds

Sharing the goodness: Let's make science open

Let's not waste a good crisis

  • Databrary.org: share video, procedures/tasks, data
    • Video the best way to capture, share procedures
    • Gilmore, R. O., & Adolph, K. E. (2017, February 9). Video can make science more open, transparent, robust, and reproducible. Retrieved from http://osf.io/3kvp7
  • Open Science Framework (OSF): share non-identifiable materials, data

Let's not waste a good crisis

Stack

This talk was produced in RStudio version 1.0.136 on 2017-04-13. The code used to generate the slides can be found at http://github.com/gilmore-lab/urise-2017-03-30/. Information about the R Session that produced the code is as follows:

sessionInfo()
## R version 3.3.2 (2016-10-31)
## Platform: x86_64-apple-darwin13.4.0 (64-bit)
## Running under: OS X El Capitan 10.11.6
## 
## locale:
## [1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
## 
## attached base packages:
## [1] stats     graphics  grDevices utils     datasets  methods   base     
## 
## loaded via a namespace (and not attached):
##  [1] backports_1.0.5 magrittr_1.5    rprojroot_1.2   tools_3.3.2    
##  [5] htmltools_0.3.5 yaml_2.1.14     Rcpp_0.12.9     stringi_1.1.2  
##  [9] rmarkdown_1.3   knitr_1.15.1    stringr_1.2.0   digest_0.6.12  
## [13] evaluate_0.10

References

Adamiak, William, Amanda Thomas, Shivani Patel, and Rick Gilmore. 2015. “Adult Observer’s Sensitivity to Optic Flow Varies by Pattern and Speed.” Journal of Vision 15 (12): 1008. doi:10.1167/15.12.1008.

Gilmore, R. O., F. Raudies, and S. Jayaraman. 2015. “What Accounts for Developmental Shifts in Optic Flow Sensitivity?” In 2015 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob), 19–25. doi:10.1109/DEVLRN.2015.7345450.

Gilmore, R.O., C. Hou, M.W. Pettet, and A.M. Norcia. 2007. “Development of Cortical Responses to Optic Flow.” Visual Neuroscience 24 (06): 845–56. doi:10.1017/S0952523807070769.

Gilmore, R.O., A.L. Thomas, and J. Fesi. 2016. “Children’s Brain Responses to Optic Flow Vary by Pattern Type and Motion Speed.” PLOS ONE 11 (6): e0157911. doi:10.1371/journal.pone.0157911.

Hou, C., R.O. Gilmore, M.W. Pettet, and A.M. Norcia. 2009. “Spatio-Temporal Tuning of Coherent Motion Evoked Responses in 4–6 Month Old Infants and Adults.” Vision Research 49 (20): 2509–17. doi:10.1016/j.visres.2009.08.007.

Jouen, François, Jean-Claude Lepecq, Olivier Gapenne, and Bennett I Bertenthal. 2000. “Optic Flow Sensitivity in Neonates.” Infant Behavior and Development 23 (3–4): 271–84. doi:10.1016/S0163-6383(01)00044-3.

Kiorpes, Lynne, and J. Anthony Movshon. 2004. “Development of Sensitivity to Visual Motion in Macaque Monkeys.” Visual Neuroscience 21 (6): 851–59. doi:10.1017/S0952523804216054.

Raudies, F., and R.O. Gilmore. 2014. “Visual Motion Priors Differ for Infants and Mothers.” Neural Computation 26 (11): 2652–68. doi:10.1162/NECO_a_00645.

Yu, Chen Ping, William K. Page, Roger Gaborski, and Charles J. Duffy. 2010. “Receptive Field Dynamics Underlying MST Neuronal Optic Flow Selectivity.” Journal of Neurophysiology 103 (5): 2794–2807. doi:10.1152/jn.01085.2009.