Depends on how late the POD, but definitely.
You need a sufficient level of understanding of aerodynamics and other concepts related to powered flight (entirely possible earlier - nothing changed in terms of some radical discovery that was not possible with earlier means), and effective engines (more difficult but entirely possible).
Note that "sufficient" aerodynamic science doesn't have to be very accurate; as Kelly Johnson said, "put enough thrust on an ironing board and it will fly." The bottleneck is thrust, getting a good, reliable, reasonably lightweight, sustainable source of it. Given the poor options available before 1900, that does put a premium on at least a good intuitive grasp of low-speed aerodynamics. This is why the Wrights followed glider development with keen interest. And also very systematically and extensively developed their own aerodynamic theory, finding none that was very good in academic science. They built their own windtunnel for instance. (Also, their own engine, finding nothing developed that was suitable).
Even so, not every insight the Wrights had was all that valuable. They certainly got something flying earlier than anyone else, but some of their notions were dead ends, at least for generations. For instance they concluded, based on looking at how glider developers like Chanute came to their sad ends, that control was paramount--which was correct as far as that went, but then they went on to figure the best control came from positive feedback, which is why their elevator was a canard, set forward of the wing. Certainly that meant that small, precise inputs were effective rapidly, and tended to increase over time, which meant the pilot had to flick the elevators up for a nose-up moment and then quickly down again to stabilize it at the desired angle--but it certainly went up to that desired angle briskly. Which is what they figured might have saved Chanute's life. However, it had no natural stability; the pilot would be constantly having to control it very carefully. The Wrights thought that was good. The long list of early American military aviators killed after being trained to operate Wright-designed machines by the Wrights themselves showed up the drawback though, and the problem, bad enough at low airspeeds, only got worse at higher ones. Modern advanced fighters use inherent instability much as the Wrights envisioned it (mostly still with the controls behind the wing rather than ahead though) for very high performance, but they do it via advanced computerized fly-by-wire controls that intervene to take the otherwise impossible burden off the pilots.
Another dead end the Wrights believed in was wing-warping as a way of achieving what is normally (soon after them that is) done by ailerons. This was related to their philosophy of very thin wing airfoils, which prevailed in France as well, but wing-warping, workable on the rather gossamer wings of the early era, was still abandoned in favor of the movable separate control surfaces. And the Germans went over to thick wings, which given the slow airspeeds of even the later WWI era could be quite thick without undue penalty, especially if the greater thickness allowed much of the exposed wires and struts to be eliminated or contained within the wings or other fairing surfaces.
So even the Wrights didn't really have a proper scientific understanding of aerodynamics, nor did any of the early pioneers. Ludwig Prandtl generally gets the credit for putting aero theory on a really sound basis, and this wasn't until the pre-WWI 20th century. (There is a Briton who was coming to much the same conclusions as Prandtl around the same time or earlier but I'm forgetting his name at the moment, anyway no one was paying attention to him.)
Aside from sheer persistence and engineering know-how, I think the biggest theoretical success the Wrights drew from their researches that helped them win was a much improved theory of how propellers worked.
I'm working on a timeline with an 1876 POD. Because of the events, there's a huge interest in rockets. I'm investigating what might be done, but if big solid rockets are reliable, then a less effective airframe could still give manned flights, with rocket engines, for a mile or two--far longer than the first airplanes. But, it would be dead-end technology...
A combination of Chinese rocket and kite technologies might have resulted in a bamboo and silk X-15 a thousand years ago. Survivors would improve the controllability, and then....
Rocket airplanes certainly could not achieve anything like the endurance or range of an engined one, but if their competition is balloons or nothing, they certainly wouldn't seem like a total dead end!
But in the Chinese case, I think the "and then..." would be, the method matures as a means of getting scouts up above a battlefield, getting messages in and out of a besieged city and other such auxiliary stunts typical of 19th century ballooning OTL, but otherwise languishes at that level until someone develops at least a steam engine--and it would have to be a very good steam engine. Maybe a Stirling-type air engine. Either way I'm not aware of any precursors to such methods being developed by the Chinese before Newcomben engines were coming into use in Britain. Perhaps one could then butterfly Chinese history so that about the time steam engine tech is developed and widespread enough to show up in China someone there is in a position to adopt it and someone else masters the theory enough to focus on making a lightweight version. Or Europeans, observing Chinese glider-planes in action, adopt or develop them themselves and similarly apply themselves to finding steam or air engines that can do the job at least as well as rockets. Whoever does this has to develop a valid theory of airscrews too, valid enough to eke out enough thrust from a marginal engine anyway.
Given the nature of aerodynamic flight, whereby a takeoff at a lower airspeed than optimum cruising speed requires a lot more thrust than maintaining optimal speed, I guess they'd keep the rockets for takeoff and possibly landing too.
Now if the Chinese glider-rockets really are exactly 1000 years before the Wrights and not centuries later, presumably the Mongols will acquire the technique (assuming they aren't butterflied away) and spread it all over Eurasia before 1400. Still, it will languish as a standard but peripheral piece of military equipment.
The idea of having a few on bigger warships will probably catch on though. Not sailing carriers! The planes just won't have impressive warfighting potential, they'd mainly be for scouting and possibly couriering messages, perhaps landing a pilot or returning them to shore, stuff like that. Every ship large enough to have room for one and a set of rockets to equip it with would have it, big ships carrying a few more. But only an engine to replace the rockets (or just supplement them) can expand their potential.
One of the men who died on gliders could've easily lived and perfected an airplane ten to twenty years early -- Alexander Mozhaysky, Otto Lilienthal, or Percy Pilcher.
I'd be particularly interested in seeing how ol' Gustave Whitehead would've faired if he'd gotten a recognized flight up in the air... I can imagine him being befuddled by all the attention.
It probably wouldn't be early enough (Whitehead, I mean) to change much in the long run, but, in the short term, it'd certainly break the Wrights's monopoly on the airplane before it even happens.
What can you tell us about Whitehead?
OTL, though the Wrights certainly did beat everyone else, they had a heck of a time proving it due to their having played their cards very close to the vest. They remained cagy, hoping to secure patents and effective monopolies on aviation, so when Santos-Dumont later flew an airplane of his own design, in clear ignorance of the Wright's earlier achievement, and unlike the Wrights was very open about how his plane worked, he was taken as the first in much of Europe; it was quite a long time before it was universally accepted the Wrights had really got there first.
Santos-Dumont also put his elevator pitch control surfaces well behind the wing, which provided for negative feedback and passive stability, which despite the somewhat less snappy control response was on the whole a big lifesaver in European aviation--France was pretty much the leading home of rapidly developing airplanes in the pre-war period. Which is why so many basic aeronautical terms are French.
I guess you would have to work with rocket banks (light three for takeoff, one for another burst of speed....). But this is certainly not going to be a technology that's viable for doing anything practical with.
I guess a glider enthusiast could come up with semi-viable controls and then strap a rocket to his device. The other way around does not souind conducive to long-term development. The main outcome of this is going to be "the rudders work, but we need some other motive power". Perhaps additional interest in both lightweight gasoline and steam engines.
As I said, I think the scope of rocket-propelled planes would be severely limited but they would have their niche uses. And in an era where no one else has any way of flying HTA at all, they'd draw a lot of attention.