This happens when the Gateway/Netprobe cannot find the lib3p64 folder. To fix this, absolute path of Sybase's lib3p64 folder must be defined in the LD_LIBRARY_PATH environment variable of the Netprobe/Gateway's start script.
Starting GA3.8.0, the protocol used by the Gateway and Netprobe to connect to a Sybase database has been modified to support a Sybase database that requires password encryption. The libraries that enable the said protocol are located in Sybase's lib3p64 folder. The libraries are a prerequisite regardless if the database is requiring password encryption or not.