Did you call them? How did it go? I had them remove the AF on my account yesterday after calling twice. 
@Open123 wrote:While the B of A is easily the best secured card, the annual fee is always problematic to remove. Good luck on removing it permanently. It is a multi step process often requiring several calls. And, even then, success is hit and miss.
From my understanding, the only way it can be done permanently is to product change from the secured to a card without the fee. The "fee" remains with the secured card even if you were to product change it into a card without a fee. Not sure how they handle it now, but in the past, it was quite an effort to remove the fee.
The linchpin is calling the right number. I've posted my experience with this here:
http://ficoforums.myfico.com/t5/Credit-Cards/BofA-New-Year-graduation/td-p/1783948
Hi,
So glad to see many reponses to my question Thank you all for your kind answers!
Up until now, I don't see any change on my account info. It's still displaying annual fee on the information tab.
But since I talked with the specialist(?) on Friday(1/4), I'm gonna wait until monday morning and see what happens.
If something comes up, I'll let you guys know!
HAPPY NEW YEAR!
--------------HERE IS THE UPDATE---------------------
So after few day's waiting, I finally checked my Annual fee going away on Wednesday(1/9)!! YEAH!
For me, calling the backdoor number on my creditcard, and talking with the Credit Analyst worked out.
I just had to wait a few days. 
Thank you again for those of you who gave me advice!!