Yes. Web controls will be effective as long as you've dialled directly into the AOL service using the AOL software and a modem. If you use any other method to connect to AOL (i.e. TCP/IP), web controls will not work.
If you are signed on to your AOL software while connected to another internet service provider then you should be aware of how Parental Controls work on third-party connections.