A jump shot by Randy Foye with 10:2 remaining in the fourth tied the game at 71, completing a 13-2 run for the Jazz. But the Sixers rattled off a 13-2 run of their own to 84-73.
The Jazz (4-6) cut the lead to 86-82 on a 3-pointer by Mo Williams, but a string of turnovers and misses doomed the Jazz who failed to close out in the final minutes for the second straight game.
Jrue Holiday led all scorers with 24 points, while Jason Richardson scored 20.
There will be little time to reflect on the loss, with the Jazz flying immediately to Washington for Saturday's game against the winless Wizards which suddenly seems a scary proposition for the Jazz, who are 1-6 on the road.
The Jazz battled back from a 12-point first quarter deficit, only to watch their own lead wither away to trail 52-43 at halftime.
Behind a second unit led surprisingly by Carroll, the Jazz went on a 17-2 run to take a 35-32 lead. However, the shots stopped falling and coach Tyrone Corbin went back to his starters and the Jazz once against began to struggle.
Al Jefferson leads the Jazz with 11 points and 4 rebounds, while Carroll added 8 points. Carroll had not played meaningful minutes for the Jazz since Nov. 2 at San Antonio and was just 4-of-12 from the field this season before making all three of his shots in the second quarter.
Philadelphia opened the game shooting 9-of-12 from the field and made their first four 3-pointers to go up 22-13.