The result brought an end to the Gunners' five-match winning streak in the league, leaving their title defence with an early stumble despite retaining top spot.
Mikel Arteta's side controlled proceedings before the interval and moved ahead in the 33rd minute. Kai Havertz dispossessed Lewis Hall before slipping a pass through to Eberechi Eze, who fired high into the net.
However, Martin Odegaard's misplaced kick under pressure from Joe Willock four minutes after the restart allowed Newcastle to level. Harvey Barnes collected possession and sent a low finish beyond David Raya, who had taken a knock shortly beforehand.
The hosts then went in front in the 62nd minute when Malick Thiaw converted from close range. Dan Burn's header from a corner created chaos in the Arsenal penalty area, allowing the defender to react quickest and turn the ball home. Raya subsequently sustained a shoulder injury and was replaced by Kepa Arrizabalaga.
Madueke eventually restored parity with a low effort that travelled through a crowded penalty area. Newcastle goalkeeper Lukas Hornicek got both hands to the shot but was unable to prevent it from crossing the line.
Newcastle improved considerably after half-time and deserved their share of the points, while Arsenal's defensive lapses proved costly.
The Gunners remain six points clear at the summit, although second-placed Brighton can narrow the gap when they face Hull on Sunday. Newcastle sit 12th with 13 points from 11 matches.