Tuesday, 8 August 2017

What we learn from the learning rate

Cells need to sense their environment in order to survive. For example, some cells measure the concentration of food or the presence of signalling molecules. We are interested in studying the physical limits to sensing with limited resources, to understand the challenges faced by cells and to design synthetic sensors.

We have recently published a paper 'What we learn from the learning rate' (free version) where we explore the interpretation of a metric called 'the learning rate' that has been used to measure the quality of a sensor (e.g here). Our motivation is that in this field a number of metrics (a metric is a number you can calculate from the properties of the sensor that, ideally, tells you how good the sensor is) have been applied to make some statement about the quality of sensing, or limits to sensory performance. For example, a limit of particular interest is the energy required for sensing. However, it is not always clear how to interpret these metrics. We want to find out what the learning rate means. If one sensor has a higher learning rate than another what does that tell you? 

The learning rate is defined as the rate at which changes in the sensor increase the information the sensor has about the signal. The information the sensor has about the signal is how much your uncertainty about the state of the signal is reduced by knowing the state of the sensor (this is known as the mutual information). From this definition, it seems plausible that the learning rate could be a measure of sensing quality, but it is not clear. Our approach is a test to destruction – challenge the learning rate in a variety of circumstances, and try to understand how it behaves and why.

To do this we need a framework to model a general signal and sensor system. The signal hops between discrete states and the sensor also hops between discrete states in a way that follows the signal. A simple example is a cell using a surface receptor to detect the concentration of a molecule in its environment.




The figure shows such a system. The circles represent the states and the arrows represent transitions between the states. The signal is the concentration of a molecule in the cell’s environment. It can be in two states; high or low, where high is double the concentration of low. The sensor is a single cell surface receptor, which can be either unbound or bound to a molecule. Therefore, the joint system can be in four different states. The concentration jumps between its states with rates that don’t depend on the state of the sensor. The receptor becomes unbound at a constant rate and is bound at a rate proportional to the molecule concentration. 


We calculated the learning rate for several systems, including the one above, and compared it to the mutual information between the signal and the sensor (the mutual information is a refined measure of correlation). We found that in the simplest case, shown in the figure, the learning rate essentially reports the correlation between the sensor and the signal and so it is showing you the same thing as the mutual information. In more complicated systems the learning rate and mutual information show qualitatively different behaviour. This is because the learning rate actually reflects the rate at which the sensor must change in response to the signal, which is not, in general, the equivalent to the strength of correlations between the signal and sensor. Therefore, we do not think that the learning rate is useful as a general metric for the quality of a sensor. Rory, Nick and Tom 

2 comments:

  1. MCX Energy Tips, Energy Chart. Get Commodity Energy Package Tips, Live Energy Chart and Energy Trading Tips Today"

    ReplyDelete
  2. I'm Olivia Megan from United State,I'm happy that my husband is back into my life after 2 years of divorce, Dr.AKHERE brought my husband back today and i am so excited. I got DR AKHERE email online when a lady was testifying about the strong spell caster who restored her marriage then I said to myself since he helped her, he can also help me,so i emailed him and told him the pain that I was going through,and he told me what to do and i did it,Then he did an urgent Love spell for me. 48 hours later, my husband came back home and with lots of love and joy,and he apologized for his mistake,and for the pain he caused me. Then from that day,our marriage was now stronger than how it were before, All thanks to DR AKHERE. Our family is complete again. If you are going through Divorce/Broke-up since DR AKHERE helped me, he can also help you..email him at: AKHERETEMPLE@gmail.com ,Thank you DR AKHERE for saving my broken Marriage and brought my husband back to me.
    Email him: AKHERETEMPLE@gmail.com
    or
    call/whatsapp:+2349057261346

    ReplyDelete