Flight scraper

Populate Kayak data

• Add a button (under Actions) that ROLE_ADMIN can run to populate flights (Kayak) for all active airports serving GVA, for a period of dates. 
  • Use same date schedule as in the Settings

Populate GVA.CH data

• On morning of T+1, run the GVA.CH scrape for ‘tomorrow’, on all flights
  • This is a one-off check, mainly to confirm that the scheduled times from Kayak match the times from gva.ch.  ie ScheduledDepartureTimeGvach === ScheduledArrivalTimeGvach
    • Chron: Run at 8am, on T+1 (ie on Monday 8am, run Tuesday's GVA.CH Overview and Details flight scraper) 
• Throughout T+0, the ‘detailed' refresh should run on “selected” individual flights, where the criteria for selection is:
  • Arrivals:
    • actualArrivalTime is null and
    • scheduledArrivalTimeGvach is after ‘now’ - 1hour 
  • Departures
    • actualDepartureTime is null and
    • status is not cancelled
    • scheduledDeparturelTimeGvach is after ‘now’ - 1hour 

Code-share

• Code share is no longer a relational field (linked to FlightTrips). 
• The Codeshare entity has a flightNumber and the record stores the associated other flights. 
  • This enables mutliple flightTrips with the same flightNumber to be linked to the CodeShare
    • So the determination has to be a lookup on a matching flight number
• The objective is to combine multiple entries for the same flight and return the code-share data in the flight details in the transfer bookings (so a user can search for their flight by any of the flight numbers)
• Check the scrape functionality on the "Operated by" to identify “child” flights (ie the ones that are going to be deleted)
• Establish a view  of all flights where there are more than one flight departing at the same time to the same location.
• Build up a list of code-shares -   question, the gva.ch notes scrape concatenates the flight numbers.  Should we maintain that array or separate into individual code-share identifiers - which will allow us to identify ones to delete?)
• Write a service that identifies the duplicates and delete