From what I have found, from the Drugs.com Drug Interaction checker, it states that:
GENERALLY AVOID: Concomitant use of tramadol increases the seizure risk in patients taking other opioids. These agents are often individually epileptogenic and may have additive effects on seizure threshold during coadministration. CNS- and respiratory-depressant effects may also be additive. In patients who have been previously dependent on or chronically using opioids, tramadol can also reinitiate physical dependence or precipitate withdrawal symptoms.
GENERALLY AVOID: Mixed opioid agonist-antagonist analgesics such as buprenorphine, butorphanol, nalbuphine, and pentazocine may theoretically decrease the analgesic effects of tramadol or cause withdrawal symptoms in patients who have been taking tramadol.
From what it says, I would suggest you not take both at the same time. Especially if respiratory-depression and/or CNS (Central Nervous System) is a symptom. Which is a very serious symptom.