On the A320 family, you turn the bleed off you lose the wing anti-ice on that side.
https://www.avsoft.com/wp-content/up...SSD-A320-3.jpg
Depending on the runway length/obstacles, taking bleed off reduces assumed temperature. This has impact on engine life/EGT margin which increases fuel consumption in the longer term.
On the later model Bleed Monitoring Computers, the bleed will shut off if there no demand.
Reference pack life, it’s not normally measured in start cycles and have not seen any evidence (Airbus TFU/ISI) that a pack start cycle has a larger impact than hours of use.