In my school, the only teachers that attend annual conferences are those of us in fine arts and DCs. The regular classroom teachers don't attend each year. YMMV.
I assumed that the OP would be allowed to attend using PD (school business) days if he/she were able to find a sub. Seems reasonable to me. Again, YMMV.