Sales of the House of Remy Martin brand were hit by unrest in Hong Kong, as well as slower-than-expected restocking by U.S. retailers.