To verify that OpenJPA is using Ehcache, view the SQL Trace to find out whether it queries the database.

If there are still problems, verify in the logs and that your ehcache.xml file is being used. (It could be that if the ehcache.xml file is not found, ehcache-failsafe.xml is used by default.)