Skip to:
Content

Opened 2 years ago

Closed 4 months ago

#1817 closed defect (wontfix)

'Count In' within post_parent() load issues

Reported by: anointed Owned by:
Milestone: Priority: normal
Severity: normal Version: 2.0
Component: Code Improvements Keywords:
Cc: stephen@…

Description

Using the bbPress converter (bbconverter.com) with Alex, we noticed that while trying to import large databases into bbPress that the importer kept crashing.

After a ton of tracking down the issue, it looks like Alex narrowed it down to the "Count In" portion of the post_parent() function. It seems that the post_parent can potentially have tons of "IN" causing this to be a very slow query.

As an example, when using the importer, if we disable bbPress first, then importing 500k posts takes about an hour, although all the data is input, it does not work though.

Turning on bbPress which activates the function in the plugin will cause the same import to take approx 2 weeks. (multiple tests run on this).

I do not personally have the expertise to fix the function, but it is an absolute showstopper for us trying to import huge external forums.

Hope the report helps.

Change History (7)

comment:1 netweb2 years ago

  • Cc stephen@… added

comment:2 johnjamesjacoby2 years ago

  • Milestone changed from Awaiting Review to 2.2

Makes sense; no time to pressure test this in 2.1, and it's not any worse than it was in 2.0. Bumping to 2.2 to get some attention then.

comment:3 netweb2 years ago

Next time I convert a phpbb board I'll do it a couple of times with bbPress enabled and disabled and note the time taken for each.

The import code is out of my league so this bug would be even further out there for me, more than happy to do any testing though.

comment:4 johnjamesjacoby19 months ago

  • Keywords reporter-feedback added
  • Milestone changed from 2.2 to Future Release

Any updates on this? With bbPress now using an updated version of the converter, and several of the queries being optimized, I'm curious if this is still an issue?

Moving to future release and adding reporter feedback tag. This can be something we iterate on until we find the exact cause.

comment:5 netweb19 months ago

I'm really only using the updated bbPress converter now and would recommend people use the built in converter rather than the the legacy bbconverter.com.

comment:7 netweb4 months ago

  • Keywords reporter-feedback removed
  • Milestone Future Release deleted
  • Resolution set to wontfix
  • Status changed from new to closed

Closing as wontfix as the the code base between these two versions of the importer are now significantly different.

Please use the built-in importer included with bbPress and create a new ticket with any new issues.

Note: See TracTickets for help on using tickets.