• Medicine
  • Astronomy
  • Sociology
  • Technology
  • Spirituality
  • History
  • Open Access
  • News

Divergent Representations Of Ethological Visual Inputs Emerge From Supervised, Unsupervised, And Reinforcement Learning

Artificial neural systems trained using supervised, unsupervised, and reinforcement learning all acquire internal representations of high dimensional input. To what extent these representations depend on the different learning objectives is largely unknown. Here we compare the representations learned by eight different convolutional neural networks, each with identical ResNet architectures and trained on the same family of egocentric images, but embedded within different learning systems.

Specifically, the representations are trained to guide action in a compound reinforcement learning task; to predict one or a combination of three task-related targets with supervision; or using one of three different unsupervised objectives. Using representational similarity analysis, we find that the network trained with reinforcement learning differs most from the other networks.

Through further analysis using metrics inspired by the neuroscience literature, we find that the model trained with reinforcement learning has a sparse and high-dimensional representation wherein individual images are represented with very different patterns of neural activity. Further analysis suggests these representations may arise in order to guide long-term behavior and goal-seeking in the RL agent. Our results provide insights into how the properties of neural representations are influenced by objective functions and can inform transfer learning approaches.

Comments (0 comments)

    Recent Articles

    • 222 Meaning - Outlining What It Represents

      222 Meaning - Outlining What It Represents

      Many people believe that the number 222 meaning is having trust and optimism within you. The number 222 has a lot of depth, strength, and meaning, and it's the key to your success. The number 2 is a symbol of tolerance and perseverance, and it has two meanings: patience and determination.

    • Gravity Wave Analogue Black Hole Spin Precession – A New Study Finds

      Gravity Wave Analogue Black Hole Spin Precession – A New Study Finds

      If the orbit of a stationary gyroscope gets smaller, the spin precession frequency would show weird things in the strong gravity area, and then it would become arbitrarily high very close to the horizon of a rotating black hole.

    • AI Build AI - Developing AI Models To Build AI

      AI Build AI - Developing AI Models To Build AI

      We have worked hard to create real machine intelligence. Maybe we should have let them get on with it. The majority of artificial intelligence is a numbers game.

    • 3D Living Cell Simulation - Researchers Developed Them

      3D Living Cell Simulation - Researchers Developed Them

      The scientists at the University of Illinois Urbana-Champaign created a three-dimensional simulation that replicated these physical and chemical features at the particle level, thereby establishing a dynamic model that replicated the behaviour of a natural cell.

    • Moons And Life On Planets - Key To Understanding Life On Other Planets

      Moons And Life On Planets - Key To Understanding Life On Other Planets

      Only Earth is known to have life on it, despite the incredible variety of worlds in our solar system. On the other hand, other moons and planets reveal evidence of life.

    • New Human Facial Expression Recognition Technology - Scientists Find

      New Human Facial Expression Recognition Technology - Scientists Find

      Human facial expression recognition is important in a variety of human-related systems, including health care and medicine.

    • Thermalization Of Radiation - A New Study Addresses The Issue

      Thermalization Of Radiation - A New Study Addresses The Issue

      The problem of the thermalization of radiation within a self-emitting hydrogen isothermal environment is the subject of many recent studies.

    • Using CBD For Pain - The Best Ways, Dosage & Delivery

      Using CBD For Pain - The Best Ways, Dosage & Delivery

      Using CBD for pain management has been accepted in all of the world's main historic civilizations, from Asia to the Middle East, Europe, and the Americas. Cannabis has been proven to be an efficient and safe analgesic for a variety of pains by scientific research over the last many decades. Pain is the most common cause for which individuals use CBD today.

    • Heterogeneity Has Consequences On Ecological Systems

      Heterogeneity Has Consequences On Ecological Systems

      Heterogeneity is a naturally chosen aspect of ecological interactions.