Stimulus control

Stimulus control
Cueing, Poisoned Cues and Faulty Cues
Thanks to Karen Pryor for the slide info!!!!!
Cue or
Command?
Why do we use “
cue
” and not
command
”?
Okay partially because it is PC
BUT: meaning behind it
Command suggests requiring or forcing
dog to do something
Cue
 is a term that “cues” the animal.
Suggests animal has a choice
Fits in with LIMA programs
Cueing
Basics
A cue is like a 
green
 light
Tells the animal that it has an
opportunity to earn reinforcement
 How? By performing the behavior
that is associated with the cue. 
There are five criteria for an
effective cue. The cue should be:
 
1. 
Easy
 to give consistently
 
2. Easily 
perceived
 
by the animal
 
3.
 
Not confused
 
with praise or
other meanings
 
4. 
Distinct from
 
other cues the
animal already knows
 
5. Easy to 
transfer
 to others
Cueing
Basics:
A 
fluent
 cue response is:
Precise
: animal performs the
behavior exactly as you had
envisioned
Performed with 
low latency
Performed with 
optimal speed
Shows 
resistant to distraction
Performed at any 
distance
from the handler
Performed for the
 
duration
required by the handler
Cueing
Basics
A cue is properly trained when
 It meets the conditions for fluency,
and 
When the criteria for stimulus
control are met. 
Criteria for fluency are:  The animal
Performs the behavior when it
perceives the cue
.
No longer offers the behavior in the
absence of the cue
.
Does not perform the behavior in
response to some other cue
.
Does not perform some other
behavior when it perceives he cue.
Ferguson
and
Rosalez-
Ruiz (2001)
Trailer loading = critical horse
behavior
Horses often not like trailers
Small, dark, confined
Aversive methods often
(usually) used
Too much negative
reinforcement and
punishment, which often
escalates to increasingly
aversive treatment
Horse
Loading
Behaviors
Back up
Move Forward
Turn left/right
Step up
Loading problems = leading
problems
Horse not going where led
Balks, turns away, etc.
Method
5 horses with poor loading history
2-horse straight load step-up trailer
Butt chain instead of butt bar
Side windows and rear doors left
open
White inside and outside
Railroad tie used as extension of
trailer deck
Target: 
Red
 pot holder
Reinforcers = typical horse treats
15 min training sessions
Method
Baseline compared to training
Loading behavior chain: horse
approach trailer:
1.
Within 3 meters (about 10
feet)
2.
Within 1.5 meters
3.
With head/neck in trailer
4.
With front legs in trailer
5.
With ½ body in trailer
6.
With 3 legs in trailer
7.
With 4 legs in trailer; less
than 5 sec
8.
4 legs in, allowed butt chain
to be fastened, door to be
closed.
Behaviors
Recorded:
Inappropriate responses/stress responses:
Amount of horse in trailer (using 8 step chain)
Freezing
Head toss
Standing
Turning
Loading:
Getting into trailer (less than 5 sec)
Loading and staying in trailer
Number of prompts
New leads (re-approaches)
Latency to respond to cue:
Within 5 sec
Greater than 5 sec
No response
Also obtained interobserver agreement (IOA)
Procedure:
Baseline: 1 day of repeated 5 min baselines
Target training: 2 days; 20-30 trials/day
Touch target
Criteria: 80% of prompts
Trailer training:
Trials to touch (just inside trailer)
Upon entry, lead back to start and
another trial
Started at each horse’s baseline distance
Added then faded trailer extension
Trained to load on left/right sides
Added limited hold with Fancy: gave several
steps to move forward
Multiple baseline design across horses
Results
All horses learned to
target during first
training session
First session:
average of about
60% accuracy
Second session:
average of 80%
Sammy took 3
sessions, but
reached 90%
All horses
able to be
loaded
Combined
horse data
All horses maintained
loading behaviors when
extension removed
Loading left and right
and new trailers
produced some
disruption but quickly
recovered
All reached 90%
Inappropriate
Responses
Most common:
Standing
Turning
Head toss
Immediately decreased
with training
Note: not targeted
Suggests these are
stress responses
Leads and
Prompts
During baseline: Few leads
and LOTS of prompts
During training:
Fewer prompts
Leads were about 1:1
with prompts
Summary:
Target
Training
WHY does
target
training
work?
Marchal,
Bregeras,
Puaux,
Gervais &
Ferry, 2016
Human Scent
Matching to
Sample
Detection
Methods
MTS
Training
Methods
Results
Initial training
Took longer to train as task grew
more complex
Dogs learned the task: NO dog has
a false alert in last 100 trials of
level 5!
Dogs were consistently good at
all types of tasks/scents when
trained to criterion and remained
at high detection rate through
continuous training
100% accuracy in judicial cases (as
judged by other dogs getting same
result)
More confessions by the
defendant when dog
identified!
WHY is
this study
important
 
Most
Common
Cueing
Problems
Poisoned
Cues
Conditioned
Positive
Cues
Poisoned
cues and
dogs
Unintentional
Cue
A very common 
unintentional cue
:
Hand signal that tells the animal “food
Is coming!”.
Cue develops from the trainer’s
unconscious habit of reaching for
the food before clicking.
Not only does this 
create a faulty
cue,
 but the movement of the hand
can actually supersede the click
and weaken its power. 
This ¡s also a surefire way to teach
your dog to be a dedicated hand or
treat pouch watcher!
Faulty
Cues
Other
Unintentional
Cues
Caution:
Don’t
poison
your cue!
Data to
support
this
position
Murrey
and
Rosales-
Ruiz:
PHASE I:
Initial
Training
Phase II
Poisoned” the “punir”
cue
.
Dog received a
gentle tug on its
leash 
if it failed to
comply within 2
seconds of
perceiving the
cue.
Note that the dog
still received a
click and treat
when It arrived in
the  proper
location
ONLY used leash
correction for 12
trials!
After 12 trials with mild
punisher, returned to
TREAT ONLY for another
50 trials
Results:
Signs of a
Poisoned
Cue
Causes of
a
Poisoned
Cue
According to Dr. Rosales-Ruiz, trainers can
poison cues in the following three ways:
Add 
aversive stimulation
 to a positive
reinforcement program.
Teach with aversive 
stimulation for
errors, and positive reinforcement for
correct behavior.
Elicit behavior with aversive
stimulation
,
 and capture it with
positive reinforcement (e.g., tying a
ribbon to a cat’s tail to
elicit a spin behavior).
The
Name
Problem
Common
Events
that can
produce
Poisoned
Cue
Cures and
Preventions
Prevent and
Solve
Poisoned,
Faulty and
Unintentional
Cues
What is
your dog
learning?
Slide Note
Embed
Share

The concepts of stimulus control and cueing in animal training, understand the importance of using cues instead of commands, and learn the criteria for effective cues to achieve fluent responses. Discover how these principles are applied in trailer loading for horses.

  • Animal Training
  • Stimulus Control
  • Cueing Basics
  • Horse Behavior
  • Trailer Loading

Uploaded on Mar 04, 2025 | 0 Views


Download Presentation

Please find below an Image/Link to download the presentation.

The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.

You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.

The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.

E N D

Presentation Transcript


  1. Stimulus control Cueing, Poisoned Cues and Faulty Cues Thanks to Karen Pryor for the slide info!!!!!

  2. Why do we use cue and not command ? Okay partially because it is PC BUT: meaning behind it Cue or Command suggests requiring or forcing dog to do something Command? Cue is a term that cues the animal. Suggests animal has a choice Fits in with LIMA programs

  3. A cue is like a green light Tells the animal that it has an opportunity to earn reinforcement How? By performing the behavior that is associated with the cue. Cueing Basics There are five criteria for an effective cue. The cue should be: 1. Easy to give consistently 2. Easily perceived by the animal 3. Not confused with praise or other meanings 4. Distinct from other cues the animal already knows 5. Easy to transfer to others

  4. A fluent cue response is: Precise: animal performs the behavior exactly as you had envisioned Performed with low latency Performed with optimal speed Shows resistant to distraction Performed at any distance from the handler Performed for the duration required by the handler Cueing Basics:

  5. A cue is properly trained when It meets the conditions for fluency, and When the criteria for stimulus control are met. Criteria for fluency are: The animal Performs the behavior when it perceives the cue. Cueing Basics No longer offers the behavior in the absence of the cue. Does not perform the behavior in response to some other cue. Does not perform some other behavior when it perceives he cue.

  6. Trailer loading = critical horse behavior Horses often not like trailers Small, dark, confined Aversive methods often (usually) used Too much negative reinforcement and punishment, which often escalates to increasingly aversive treatment Ferguson and Rosalez- Ruiz (2001)

  7. Back up Move Forward Turn left/right Step up Horse Loading Behaviors Loading problems = leading problems Horse not going where led Balks, turns away, etc.

  8. 5 horses with poor loading history 2-horse straight load step-up trailer Butt chain instead of butt bar Side windows and rear doors left open White inside and outside Railroad tie used as extension of trailer deck Method Target: Red pot holder Reinforcers = typical horse treats 15 min training sessions

  9. Baseline compared to training Loading behavior chain: horse approach trailer: 1. Within 3 meters (about 10 feet) 2. Within 1.5 meters 3. With head/neck in trailer 4. With front legs in trailer 5. With body in trailer 6. With 3 legs in trailer 7. With 4 legs in trailer; less than 5 sec 8. 4 legs in, allowed butt chain to be fastened, door to be closed. Method

  10. Inappropriate responses/stress responses: Amount of horse in trailer (using 8 step chain) Freezing Head toss Standing Turning Loading: Getting into trailer (less than 5 sec) Loading and staying in trailer Behaviors Recorded: Number of prompts New leads (re-approaches) Latency to respond to cue: Within 5 sec Greater than 5 sec No response Also obtained interobserver agreement (IOA)

  11. Baseline: 1 day of repeated 5 min baselines Target training: 2 days; 20-30 trials/day Touch target Criteria: 80% of prompts Trailer training: Trials to touch (just inside trailer) Upon entry, lead back to start and another trial Started at each horse s baseline distance Procedure: Added then faded trailer extension Trained to load on left/right sides Added limited hold with Fancy: gave several steps to move forward Multiple baseline design across horses

  12. Results All horses learned to target during first training session First session: average of about 60% accuracy Second session: average of 80% Sammy took 3 sessions, but reached 90%

  13. Baseline: no horse able to get beyond step 4 After initial target training: Range of step 6 to step 8 All horses able to be loaded Fancy: 5 to 6 mastered When added extension: all but Fancy reached criterion performance Fancy outwitted researchers: could stretch to touch target even with extension Had to add the limited hold condition to outwit him.

  14. Combined horse data All horses maintained loading behaviors when extension removed Loading left and right and new trailers produced some disruption but quickly recovered All reached 90%

  15. Inappropriate Responses Most common: Standing Turning Head toss Immediately decreased with training Note: not targeted Suggests these are stress responses

  16. Leads and Prompts During baseline: Few leads and LOTS of prompts During training: Fewer prompts Leads were about 1:1 with prompts

  17. Target training decreased inappropriate responses secondary to increasing trailer loading Summary: Target Training Target training established stimulus control This allowed stimulus control during situations which usually elicited problem behaviors Horses so busy focusing on target that they ignored poisoned cues

  18. Avoids learned helplessness Dogs learn to move or do something else to get a reward when NOT clicked Gives organism control over the environment Opposite of LH, where learn that their behavior has no power WHY does target training work? Not so much that it is all positive , as it is teaching the rule that you either must Do what you just did to get the click Or if that doesn t work, do something different not behavior is not an option Teaches creativity , persistence , resistance

  19. Scent detection (drug detection, human identification, location, etc.) by canines used commonly in law enforcement Marchal, Bregeras, Puaux, Gervais & Ferry, 2016 Human Scent Matching to Sample Detection Results of dog detection often not admissible in courts because of lack of rigor and standardization of training for scent with the dogs Does seem to be a reliable training method- matching to sample- that is readily available and easily used, but few law enforcement agencies use it Study wanted to demonstrate effectiveness of this approach

  20. Dogs: 13 Shepherd dogs, all out of Hungarian breeding program and French training program Dogs started at about 10 mos of age Trained for about a year each Dogs trained 5x per week in special work room Methods Rubber floors Five jars on metal tripods Human scent collected by qualified tech and collection method Body scent Trace scent

  21. Dog given jar with scent to sniff Dog brought to line and shown jars along line Match scent to original jar Given food treat if correct Had to place nose in jar; later trained an alert behavior Started with 1 jar; increased up to 5 Steps 1 to 3: Tech puts out scent in one of jars; blind to dog and handler Dog must identify; handler must call alert Step 4: MTS Training Methods Target person scent plus DISTRACTOR scents Dog must identify scent of the identified person Step 5: Criterion: Hits, misses, correct rejections and false alarms calculated Had to get 100% correct for 100 successive trials! Only dogs meeting 100% correct for 200 trials moved to step 5, or remained in training Then continue in continued training until judicial cases Judicial cases: actual court cases (minimum of 3 dogs detected on each case)

  22. Initial training Took longer to train as task grew more complex Dogs learned the task: NO dog has a false alert in last 100 trials of level 5! Dogs were consistently good at all types of tasks/scents when trained to criterion and remained at high detection rate through continuous training 100% accuracy in judicial cases (as judged by other dogs getting same result) More confessions by the defendant when dog identified! Results

  23. Currently, scent detection not admissible in court WHY is this study important Too much inconsistency This shows that it is poor training, not poor dog ability HOW you train is critical! Also shows importance of having learning experts develop the training!

  24. Poisoned cuescues that have a negative connotation or negative emotions for the learner Most Common Cueing Problems Faulty/Unintentional cues cues that are not clear to the learner, the trainer, or both

  25. Poisoned Cue = cue that has negative connotations or negative emotions associated with it for the learner. A cue can become poisoned when Poisoned Cues It is enforced or taught with force or punishment (even inadvertently), Resulting in an animal that feels conflict or fear when it perceives the cue. Poisoned cues = useless as tools for operant conditioning because they have no positive reinforcement value

  26. Conditioned Positive Cue = cue taught with positive reinforcement The basis for success and reliability when teaching and working with complex behavior chains. Poisoned Cue = cue taught or paired with punishment. Conditioned Positive Cues An example of how a Positive Cue can become Poisoned: Green light to a driver is good news yes you can go now. Over thousands of repetitions drivers feel happy to see the light change to green. A certainty develops: You CAN proceed through a green light. Foot moves to the gas pedal automatically as we see the light turn green. What happens if another driver runs a red light and we are injured as we are responding to the green light cue? Taints or poisons the cue Will be hesitant, anxious, uncertain

  27. Animals show same ambivalence to a cue that has been poisoned. Cue is no longer guarantee of good things to come. In fact, may result in adverse consequence. Uncertainty causes emotional distress Poisoned cues and dogs Result: Deterioration in performance. Common myth among dog trainers: Once a dog knows a behavior and for some reason does not respond as instructed, the dog should be corrected. Problem: It taints or poisons the cue!!!!!!

  28. A very common unintentional cue: Hand signal that tells the animal food Is coming! . Cue develops from the trainer s unconscious habit of reaching for the food before clicking. Unintentional Not only does this create a faulty cue, but the movement of the hand can actually supersede the click and weaken its power. Cue This s also a surefire way to teach your dog to be a dedicated hand or treat pouch watcher!

  29. Faulty cues = cues that are not clear to the trainer and/or the learner. Commonly, cues become faulty when: Unintentional extraneous elements (movements, sounds, etc.) have become part of the animal s perception of the cue. A trainer makes a cue different (louder, bigger gestures), and these extraneous elements become part of the trainer s perception of the cue, but are confusing the animal. Faulty Cues

  30. Trainers will often unconsciously speak more loudly or give more expansive hand gestures if the animal does not respond to the cue. The dog learns say it really loud before I comply Repeating the cue: dog learns say it three times before I comply! Other Unintentional Cues Dog learns repeat it several times before I do the behavior These extra aspects can become part of the cue from the trainer s perspective, BUT: are irrelevant or, even worse, confusing to the animal.

  31. Trainers error: Believe that at some point dog has learned it well enough that it should Just do it . Decide to punish noncompliance. Actions will likely create a poisoned cue, and the dog will lose at least some of its faith in the cue Caution: Don t poison your cue! Many people believe that they must tell the dog when it has done wrong, Believe that dog will actually learn faster if It has a clear choice: Comply and get a cookie, Disobey and get a verbal or physical reprimand But actually poisons the cue!

  32. Dr. Jesus Rosales-Ruiz of the University of North Texas and his graduate students have been conducting experiments to determine just how cues actually work. Data to support this position According to the work of Dr. Rosales- Ruiz: even a small (seemingly inoffensive) physical correction can become associated with a positively trained cue can cause emotional distress in a dog Result: Deterioration in performance of a previously fluent cue

  33. The Study: Condition #1: train using positive reinforcement: two cues: Ven and Punir Condition #2: Poisoned Punir , Then returned to positive reinforcement. Murrey and Rosales- Ruiz: ABA design: 17 sessions of baseline 12 sessions: Ven: C/T Punir: Tug if not react within 2 seconds of cue; C/T if did 50 sessions: C/T for both cues Why use an ABA and not an ABAB?

  34. Two cues, ven and punir, Both cues meant the same thing: come to the square on the floor n front of the handler. Both cues were trained to fluency with shaping and positive reinforcement. All training sessions were conducted n the same room, with the same dogs, and with the same trainer. PHASE I: Initial Training 17 sessions: Both cues were trained to 100% accuracy with shaping and positive reinforcement

  35. Phase II Poisoned the punir cue. Dog received a gentle tug on its leash if it failed to comply within 2 seconds of perceiving the cue. Note that the dog still received a click and treat when It arrived in the proper location ONLY used leash correction for 12 trials! Cue Goal Behavior Consequence Ven Touch briefcase in right corner Correct? Treat Incorrect? Nothing Punir Touch trash can in left corner Correct? Treat Incorrect: mild leash tug After 12 trials with mild punisher, returned to TREAT ONLY for another 50 trials

  36. Significant differences in the speed and accuracy of the target touch Dogs in Ven condition are faster and more accurate Dogs in punir condition are slower and show shyness Results: Significant difference in the attitude of the dog even though there is no more tugging. Dog in tug condition shows conflict Dogs in ven condition rapidly approach new task Dogs in punir condition are slow and hesitant

  37. Obviously, impossible to know what our animals are thinking, BUT IS possible to observe their behavior. Signs of a Poisoned Cue Signs that an animal is working under a poisoned cue are obvious: Default to a favored behavior (often sit or down ) Displacement behaviors (licking, sniffing, head down) SluggIsh response Lack of response Looking for an escape Submissive behavior Anxious facial expression

  38. According to Dr. Rosales-Ruiz, trainers can poison cues in the following three ways: Causes of Add aversive stimulation to a positive reinforcement program. a Teach with aversive stimulation for errors, and positive reinforcement for correct behavior. Poisoned Cue Elicit behavior with aversive stimulation, and capture it with positive reinforcement (e.g., tying a ribbon to a cat s tail to elicit a spin behavior).

  39. One area in which many trainers unwittingly put the poisoned cue phenomenon to use: Use a nickname or pet name when they are happy with the dog Use a more formal name when the dog is in trouble! (Keno Bernard!) Some people do this with their children as well. The dog s name!. The Name Problem Though it s often unintentional on the trainer s part, it is actually a good way to avoid poisoning the dog s name.

  40. Shelter dogs with poor training histories Common Events that can produce Poisoned Cue A well-trained dog forced to comply in a stressful situation (at a field trial for example) Painful or uncomfortable veterinary or grooming procedures become associated with the cue Accidental pairing of an aversive as you give the cue: E.g., car backfiring at the same time as the dog is picking up a dropped object could poison the pick it up cue for a noise-phobic dog. Threats from other dogs can poison cues for sensitive dogs in multi-dog settings.

  41. PREVENT a cue from being poisoned in the first place! Can be very easy to get rid of poisoned cues: Simply reshape the behavior and then add a new cue. With a clicker savvy dog this can happen in a matter of minutes. Cures and Preventions Changing the cue is essential, The poisoned cue will always have some negative emotions attached to it. Shelter dogs often come with a lot of baggage left over from poor, abusive,or confusing training. Giving the dog a new name and retraining basic behaviors from scratch, with new cues ,may be just what the dog needs to become a confident and well-mannered canine

  42. Practice good clicker mechanics. Prevent and Solve Poisoned, Faulty and Unintentional Cues When using prompts and lures to jump-start a new behavior, fade lures as quickly as possible. Minimize cues when possible smalIer cues are easier to give consistently. Identify and clean up any cues that contain extraneous elements.

  43. Sit taught with C/T and correction: Sit now means maybe a good thing And maybe a bad thing. Even if the dog responds correctly, he is What is your dog learning? Sit taught with C/TResult: Sit means always a good thing If the dog fails, nothing happens. The cue become carries important information, Serves as a powerful (secondary) reinforcer https://www.youtube.com/watch?v=hb4ceRjLVnw https://www.youtube.com/watch?v=hb4ceRjLVnw

More Related Content

giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#