The Warrens, after speaking with Donna, Angie, and Lou came to the immediate conclusion that the doll itself was not in fact possessed but manipulated by an inhuman presence.
Spirits do not possess inanimate objects like houses or toys, they posses people. An inhuman spirit can attach itself to a place or object and this is what occurred in Annabelle's case.