Son Hai Ha
This problem is also fixed now. A lot of ports have to be opened for Ganglia, both UDP and TCP types. I think the manual should contains these information, otherwise for beginner like me, it took a week to figure out the problem.
Thank you guys for helping!